Data Engineer/lead Resume
Rockville, MD
SUMMARY
- 11+ years of working experience in different domains - Hospitality, Retail, Financial/Investment services, Government, Health Care and Media.
- Highly passionate about learning and acquiring new skills. Inquisitive and curious about new trends in the field of market, customer, Data analytics.
- Commendable expertise in understanding of business drivers and value-creation.
- Extensive experience in Data Warehousing, Data Analysis, Data Engineering, Data Science, and Insights.
- Analyzed different touch points in lifecycle of infrastructure from Customer experience and engagement perspective and delivered personalized experience for customers. Strategic, customer and data driven consultant, with experience in analytics solutions engineering.
- Good understanding and sound knowledge in the concepts of Cloud, DataLake, Data Modelling, Data Warehouse and Data Marts. Strong experience in relational databases and big data.
- Strong Knowledge of Database Architecture, Design, OLAP features, BI best practices, standards, data mappings and data models using ERwin; optimized data warehouse and reporting performance-tuning.
- Proficient in Data Extraction, Transformations and Loading techniques and methods.
- Performed Data Governance tasks such as Data quality, data change, meta data, monitoring, measurement, documentation, and impact analysis.
- Familiarity in evaluating big data analytics libraries and use of Spark-SQL for data exploratory. Efficient in optimizing, system testing, troubleshooting, debugging, and providing resolutions.
- Automation of Build/Deployment/Environment Management areas by implementing CI / CD pipelines to help teams deliver a better, reliable software into Production environments.
- Strong experience in client interaction and understanding business application, business data flow and data relations from them.
- Experience in large scale data analysis both structured and unstructured data, extensive experience in data analysis and creating data sets from multiple source systems.
- Key areas of expertise are requirements gathering, and requirements analysis, converting business requirements to functional and technical specifications, designing ETL processes, and dimensional modelling (Star/Snowflake schema).
- Performed data analysis/data profiling/Data quality/ deduplication tasks.
- Sound knowledge of Spark and its components: SparkCore, SparkSQL, Spark Streaming. Experience working with Spark and optimizing Hive Query performance.
- Some experience with programming and analyzing data using python.
- Experience in creating RDD, Data frames for the required data and did transformations using Spark RDD's, Spark SQL. Used Spark Structured Streaming to preform necessary transformations.
- Exposure in evaluating big data analytics libraries and use of Spark-SQL for data exploratory.
- Developed scripts for data cleansing, summarization, filtering, and transformation using spark and python programming.
- Proficient in Data Extraction, Transformations and Loading techniques and methods. Efficient in Optimizing, Debugging, and testing SQL queries.
- Strong experience in client interaction and understanding business application, business data flow and data relations from them.
- Strong coding ability in SQL, learnt data mining and statistical analysis (predictive analytics, hypothesis testing, regression etc.), pandas, matplotlib and multivariate analysis using Python and latest ML and AI platforms and technologies.
- Performed production support activities such as code deployments, issues resolution post-production deployment, on call support.
- Interacted with project stakeholders, business partners and technical teams to collate business requirements, processes and needs. Documentation of functional and non-functional models.
- Maintenance of project logs and its resolutions. Project schedules, milestones, timelines, and deliverables discussions with management.
- Streamlined the business processes and procedures by addressing identified problems and gaps to improve efficiency of business units.
TECHNICAL SKILLS
Big Data/Cloud Technologies: AWS (S3, Redshift, Glue, EMR, EC2, RDS), Microsoft Azure services (Azure Analytics, blob storage, SQL Data Warehouse), Hive, Impala, HDFS, Spark, Kafka, Airflow.
Databases: Oracle, Teradata, Postgres SQL, Sybase IQ/ASE, SQL Server, My SQL, Splice Machine.
Analytics/BI Tools: MicroStrategy, Qlik Sense/View, Tableau, Google Analytics, Business Objects.
Languages/Tools: SQL, PL/SQL, Python, C, C++, Linux Shell Scripting.
Application Software: GIT, Jenkins, Apache Tomcat, AWS.
Source Control Tool: GIT, SVN.
Web Servers: Apache Tomcat, Web Sphere, Web Logic, IIS.
Web Technologies: HTML, DHTML, CSS, XML, VB Script, JavaScript.
ETL Tools: SSIS, Informatica, Syncsort DMX-h, DataStage.
Operating Systems: Windows, Linux, UNIX.
PM Agile Tools: VersionOne, JIRA, Confluence.
PROFESSIONAL EXPERIENCE
Data Engineer/Lead
Confidential
Responsibilities:
- Led the development of experience strategies rooted in business and brand goals, customer data and channel-level best practices.
- Provided many sessions in Information Technology Solutions space to multiple clients.
- Especially, provided road map for the integrated data analytical platforms.
- Provided process-oriented services to the many clients.
- In depth understanding of Enterprise layer and tables which consists of Hotel Reservations, bookings, stay, enterprise, and customer view etc.
- Successfully executed AMResorts analytics which is useful for AMR stay reconciliation daily and monthly data feeds.
- Provided IT consulting services, road map for the integrated data analytical platforms to some of the clients.
- Provided process-oriented services.
- Able to craft AMR data related to reward redemption pricing, hotel fee and reimbursement structures, point earning and credit card transactions.
- Participated in projects requirement meetings.
- Analysed the data and reports using different database views of Teradata Datawarehouse.
- Performed Data migration and TEMPhas data processing experience in using AWS services: S3, Kafka, CDC processing, Redshift, Spectrum, Vertica, Hive, NoSQL, Spark.
- Performed detailed data analysis/data profiling/Data quality/ deduplication.
- Developed scripts for data cleansing, summarization, filtering, and transformation.
- Implemented Tableau Analytics.
- dis application uses different platforms and tools such as Salesforce, Marketo, Higher Logic, Google Analytics, Business Intelligence Tools, ETL tools, Databases and Programming Languages.
- Extensively worked on Analytical solutions, Architectural patterns, Snowflake SnowSQL Data warehousing, AWS services, Python, Unix/Linux scripting, Spark data processing, Maintained scripts, functions, SQL code reviews.
- Translated complex business requirements into structured analytical use cases.
- Participated in project requirement meetings.
- Projects were implemented in cloud based Continuous integration and continuous deployment mode.
- Assessing and cultivating long-term strategic goals for BI development in conjunction with users, executives, and other stakeholders.
- Organize and leading the integration efforts for merging BI platforms with enterprise systems and applications.
Data Engineer / Software Developer
Confidential, Rockville, MD
Responsibilities:
- Provided many sessions in Information Technology Solutions space to multiple clients.
- Especially, provided road map for the integrated data analytical platforms.
- Provided process-oriented services to the many clients.
- Data processing, data quality, data profiling and experience in extracting both structured and unstructured data files. Learnt and leveraged big data technologies - AWS, python, spark, Kafka, and Airflow.
- Worked for different clients during my tenure at Quantum Vision, implemented a company-wide analytic model and delivered Data Analytics across multiple departments.
- Expert in relational databases, big data, and delivering insights to stakeholders and end users by processing big data using different visualization techniques.
- Efficient in optimizing, system testing, troubleshooting, debugging, and providing resolutions.
- Implemented Data Analytics using SQL, python, spark, Linux Shell Scripting.
- Automation of Build/Deployment/Environment Management areas by implementing data (CI / CD) pipelines to help teams deliver a better, reliable, and certified software into lower level and Production environments.
- Worked on Data Ingestion using Spark, Python, SQL, and Kafka.
- Designed and developed ETL integration patterns using Python, Spark. XML processing using python.
- Built PySpark framework for converting ETL data mappings and optimized PySpark code to run on Kubernetes Cluster for faster data processing.
- Good understanding of Spark’s Data sources API, RDD API, Dataframe.
- Experience in performance tuning, troubleshooting, and monitoring spark jobs.
- Created RDD, Data Frames for the required data and transformations using Spark RDD's, Spark SQL, learnt workflow management using Airflow.
- Enhanced additional skills on Big Data Engineering latest Technologies such as MicroSoft Azure services (Azure Analytics, blob storage, SQL Data Warehouse), Snowflake, Spark (Scala), Python, advanced data analytics concepts and algorithms.
- Attended AWS Training sessions -- ML basics, Sagemaker workflow and built-in algorithms.
- Provided documentation and technical expertise, details for proposal submissions.
Data Engineer / Software Developer
Confidential, Rockville, MD
Responsibilities:
- Recommended areas of improvement in growth, standardization, marketing, customer engagement, profitability, Revenue management and rentals.
- Contributed transformation techniques, process optimization, best practices and use cases for Customer Analytics, Location Intelligence, big data solutions using AWS cloud services.
- Assembled and interpreted multiple important key performance indicators to ensure the most effective path to success.
- Successfully completed Big Base Layer build (DAP), which consists of Base Layer Reservations, Cancellation, both historical and current versions.
- Implementation of preview, post views for reservations. Utilized different views to generate AMR reporting.
- In depth understanding of Enterprise layer and tables which consists of Hotel Reservations, bookings, stay, enterprise, and customer view etc.
- Successfully executed AMResorts analytics which is useful for AMR stay reconciliation daily and monthly data feeds.
- Able to craft AMR data related to reward redemption pricing, hotel fee and reimbursement structures, point earning and credit card transactions.
- Data migration and data processing experience in using AWS services: S3, Kafka, CDC processing, Redshift, Spectrum, Vertica, Hive, NoSQL, Spark.
- Performed detailed data analysis/data profiling/Data quality/ deduplication.
- Developed scripts for data cleansing, summarization, filtering, and transformation.
- Implemented Tableau Analytics.
Data Analyst / SQL Developer
Confidential, Linthicum Heights, MD
Responsibilities:
- Worked as Sr. Data Analytics Engineer and analyst to support the CJAMS project for client Confidential through MD Think.
- Collaborate with client to gather analytics requirements and source data analysis/profiling from multiple source systems and identify key data elements, structures.Design and implement analytics functionality for Business end users.
- Involved in the entire data science project life cycle and actively involved in all the phases including data cleaning, data extraction and data visualization with large data sets.
- Extensively worked on integrating multiple business areas to achieve consolidated view of the same for CJAMS Analytics Mart.
- Implemented variety of trends, reports and dashboards dat cover multiple subject areas of the CJAMS project such as Case/Client/Provider/Finance management including Federal reporting.
- Review and evaluate the existing data sources and analyze the conversion steps required.
- Responsible for writing SQL Queries for analysing data in Postgres SQL.
- Developed scripts for end user / analyst requirements to perform ad hoc analysis.
- Worked on real time data ingestion using Kafka and applied transformations.
- Parsed JSON, XML and CSV files and extracted insightful information which is useful for dataloads.
- Experience writing scripts for data cleansing, ETL operations and query optimization and maintenance of existing scripts.
- Implemented new apps and features in Qlik with trends and visualizations for Federal Reporting.
- Participated in Scrum backlog priorities, brainstorm sessions, defect review and code drop planning meetings for business process improvements.
- Ownership of cross team issues and delivery issues including pro-actively communicating across teams to coordinate activities.
- Support testing and deployment of the solution to ensure it meets business requirements.
Business Intelligence & Data lead / Systems Software Analyst
Confidential, Boston, MA
Responsibilities:
- Propose dashboard design options dat is best fit for the proposed use cases and flexible to scale for multiple studies/use cases.
- Coordinate with onsite team, client and offshore team on deliverables and take ownership of same.
- Identified opportunities, provided expert advice and leadership in improvising visualization, usage, and interpretation of data for reporting in each business area.
- Collaborate with data team and business to determine appropriate reporting architecture for the dashboards, factoring in need to scale and expand to multiple use.
- Provided analytical support for all MicroStrategy dashboard related requests.
- Provided expertise in MicroStrategy calculations, Dashboard visualizations and data blending.
- Worked on qualitative measurement, attitudinal measurement and achieved multi-channel marketing with the help of advanced analytics and modeling.
- Reviewed event flow and discussed approach leveraging center account plans to capture HCP analysis and deliver rep-triggered emails leveraging defined actions from these account plans.
- Led MCM activities to drive adoption, penetration, prescription by working with cross functional teams.
- Led the development of experience strategies rooted in business and brand goals, customer data and channel-level best practices.
- dis application uses different platforms and tools such as Salesforce, Marketo, Higher Logic, Google Analytics, Business Intelligence Tools, ETL tools, Databases and Programming Languages.
- Assessing and cultivating long-term strategic goals for BI development in conjunction with users, executives, and other stakeholders.
- Organize and leading the integration efforts for merging BI platforms with enterprise systems and applications.
- Analysed user requirements and based on findings, designed functional and technical specifications for the project. Responsible for project planning, execution, and timelines.
- Responsible for trouble shooting and data model design changes.
- Work closely with stakeholders, business users, ETL developers, product owners, DBAs, and consumers of data to develop and implement the BI solutions.
- Coordinate with cross-functional teams and project management to ensure on-time delivery.
Senior Data & MicroStrategy Architect / Admin / Systems Software
Confidential, Fairfax, VA
Responsibilities:
- Collaborate closely with client to gather BI report requirements and performed Confidential Analysis and translate them to technical requirements.Design to implement different reporting functionality for Business end users.
- Addressed Data Modeling issues using different data warehouse concepts like logical views, table aliasing etc.
- Performed tasks related to data warehouse which was built in Oracle for Open Payments project.
- Worked on business data analysis, reconciling the data, built different key performance indicators and dimensions for better analysis to support variety of business decisions.
- Implemented Star and snowflake schemas for Open Payments DataMart.
- Creating Oracle views, writing SQL queries in optimized way to be compatible with Open payments MicroStrategy reporting environment.
- Implemented variety of reports and dashboards dat cover different cycles of the Open Payments project such as Registrations, Recertifications, Submissions, Review & Dispute and Delay in Publication.
- Creation of entire metadata with all kinds of semantic layer objects and reporting layer objects to construct extensive number of adhoc reports, datasets, documents, dashboards, and visual analysis.
- Implemented good number of Change Requests during my tenure at CGI and interacted with all levels of members in the project.
- Utilized features like prompts, pivot tables, column selector and hierarchy.
- Strong Knowledge of all phases of Software Development Life Cycle (SDLC) such as Requirement Analysis, Design, Development, Testing, UAT, Implementation and Postproduction support.
Senior Data & MicroStrategy Architect / Systems Software Analyst
Confidential, North Brunswick, NJ
Responsibilities:
- Responsible for planning, design, development and writing the solution specifications for all phases project implementation.
- Collaborated with all levels of users from executives to business users in gathering information for full application life cycle engagement.
- Responsible in creating and maintaining data models, schema manager, user management, integration, scalability/tuning, quality assurance and configuration management.
- Created Custom reports, KPIs and Dashboards using MicroStrategy reporting.
- Responsible for trouble shooting and data model design changes.
- Responsible for Project planning, management, execution, risk management and timelines.
- Designed, developed, tested, and maintained business objects functional reports based on User requirements.
- Provided necessary training for the users. Supporting DW/ETL team to address data load and schema issues.
- Extensive experience in data analysis and reporting.
- Translating Business requirements into Functional and Technical specifications to fulfil Securities Lending business needs.
- Wrote end user manuals and trained users on the new Securities Finance Analytics application.
- Testing the application for user acceptance
Analytics & Data Warehouse / Systems Software Analyst
Confidential, Milwaukee, WI
Responsibilities:
- Implemented Analytics/BI/Data Warehouse assessment project for client Kohl’s and submitted a proposal.
- Integrated BI systems for Programming and Prod-ops (Travel) divisions. Managed and mentored a team of developers for ESPN.
- Working closely with stake holders and Business end users to discuss and understand project, reporting requirements, data models and its functionality.
- Extensive experience in Star and snowflake schemas.
- Worked on Confidential analysis, design, and creation of extensive number of adhoc reports, datasets, documents, dashboards using Attributes, Facts, Metrics, Filters, Transformations, Consolidations, Custom groups, different kinds of Prompts.
- Creating, publishing, and scheduling Intelligence Cubes to improve performance of reports and dashboards. Used them as datasets for documents and dashboards.
- Analysing reports and documents on an iPad and creating reports and documents for iPhone and iPad.
- Created multiple documents and datasets using BI product suites.
- Built legacy business objects reports and documents in MicroStrategy.
- Performed all kinds of admin tasks installation of MicroStrategy suite, setting up user security, managing projects, configuring, and connecting to intelligence server, Object Manager, Enterprise Manager, web, and distribution services.
- Involved in the creation of Logical views with complex Queries against Data Warehouse to address data modeling issues. Supported Data Warehouse assessment work.
- Utilized DBquery, connectivity wizard, ODBC administrator data sources.
- Worked extensively in maintaining development, QA, production environments and worked on creation of packages and Dev, QA, production migration activities using Object Manager.
Data Modeler / MicroStrategy / Systems Software Analyst
Confidential, Merrimack, NH
Responsibilities:
- Complex environment where high volume, velocity, variety of data going exponentially, addressed grand analytics challenges.
- Working closely with clients and Business end users to discuss and understand project, reporting requirements, data models and its functionality.
- Extensive experience in Data Modeling.
- Designed and created extensive number of reports, documents, interactive dashboards using Schema and Application Objects.
- Creating Intelligence Cubes and publishing them for better performance. Also worked on SQL Certification, change logs. Attending object review/change log meetings.
- Worked on design and development of Scorecards to display graphical indicators like trends, indicators etc. dat visually convey the performance of business.
- Performed all kinds of admin tasks installation of MicroStrategy suite, setting up user security, managing projects, configuring, and connecting to intelligence server, Object Manager, Enterprise Manager, web, and Narrowcast server for report delivery.
- Worked on creation of DB instances, project configuration and multi sourcing etc.
- Worked report and document performance improvement techniques.
- Participated in discussions and training sessions with end users before and after release to UAT and implemented different enhancements, new changes and requirements.
- Performed Unit testing and regression testing of reports during development and after migrations.
Systems Software Analyst
Confidential, San Francisco, CA
Responsibilities:
- Agile environment, involved in lot of brainstorming sessions and scrum meetings with the Product Managers, development, and testing teams.
- Involved in the meetings with clients and Business Users to discuss and understand development, staging and production environment of the project.
- Extensive experience in dimensional modeling (Star / Snowflake schema).
- Designed and created Adhoc and report builders using Schema and Public Objects.
- Implemented sales related metrics like Revenue, Revenue (Previous Quarter), Revenue by Sales Representative, Revenue (Region filtered), lost opportunities, wins vs competitor, mean and % Contribution to Total Revenue metrics.
- Creating Intelligence Cubes and publishing them for better performance.
- Extensive knowledge in creating Dynamic Enterprise Dashboards using different controls, attribute selectors, metric selectors, panel selectors, sliders, widgets and utilized the new features to convert the Dashboards into Flash mode, and incorporated Dashboards with linking (Hyperlinks, edit links), drilling capabilities, filtering, slicing.
- Worked on design, developing, maintaining, and integrating wide variety of Scorecards to enable the associates to measure their monthly/annual performance.
- Analysing reports and documents on an iPad and creating reports and documents for iPhone and iPad.
- Worked on creation of LDAP filters using LDAP attributes for different user logins like Regional Managers, Store Managers etc. using OPR NBR, Parent OPR NBRs based on locations like EU, USA, China.
- Involved in the creation of Logical views with complex Queries against Data Warehouse.
- Maintained report caches and access control lists.
- Participated in review sessions with Product Managers if their are any new or change of requirements, getting sign-off and communicating with the technical teams regarding all changes or modifications.
- Worked extensively in maintaining production and worked on production migration activities using Object Manager.
MicroStrategy Developer / Programmer Analyst
Confidential, Jersey City, NJ
Responsibilities:
- Apply principles and techniques of computer sciences and quantitative methodologies techniques to determine feasibility of design.
- Design, program and implement software (MicroStrategy) application packages which can be customized to meet specific requirements.
- Review existing computer systems to determine compatibility with projected or identified requirements. Research and select appropriate systems including ensuring forward compatibility of existing systems.
- Testing and implementing the system to provide analytical support to monitor operation of assigned application system. Supporting the project team by participating in enhancements and develop accurate documentation dat complies with the company standards.
- Learnt business intelligence enterprise system components, object modeling, attribute relationships and creation of logical tables, views.
- Assisted the DBA’s and the ETL architects to design and create Tables in the SQL server database to improve the performance of reports.
- Taken care of change requests, work requests, code migrations between different environments for projects NPR and APL.
- Performed data validations using SQL queries.
