Sr Architect/consultant Resume
Boston, MA
SUMMARY:
- Over 13 plus years of experience in various software tools and application packages, Client/Server business systems design/analysis, Data Warehousing and application development.
- Over 5 Years of experience working on mainly Amazon Web Services (AWS).
- Hands - on experience with architecting, automating infrastructure components onAWSand migrating On-Premise infrastructure to the Cloud.
- Hands-On experience in for asset configuration and management, logical access control, data encryption, network configuration and management, security, logging and monitoring inAWSenvironment.
- Hands-On experience in designing and developing n-tier applications on the Cloud and On-Premise
- Mastery of the Amazon Web Services (AWS) cloud computing platform, and its many dimensions of scalability - including but not limited to: VPC (Virtual Private Cloud), EC2, load-balancing with ELB, messaging with SQS, auto scaling architectures, using EBS under high I/O requirements, custom monitoring metrics/analysis/alarms via Cloud Watch etc.
- Architected and deployed security-conscious infrastructure within an AWS VPC environment. Understand what services are and are not available in a Public Cloud infrastructure via AWS.
- Experience designing and implementing complex, HA multi-tier, end-to-end solutions using a wide variety of private cloud offerings, including AWS EC2, S3, ELB, RDS, Route 53, RDS, IAM, Cloud Front and Auto Scaling.
- Ability to effectively address data security concepts in public cloud as it relates to customer needs including an in depth understanding of Federated Security / Single Sign On, and AWS IAM
- Created Python Scripts to AutomateAWSservices which include web servers, Cloud front Distribution, databases, EC2 and database security groups, S3 buckets and application configurations.
- Ability to develop high level and detailed design documents addressing the business, infrastructure, security, support and operational needs of the business.
- Configured aggregation of Cloud Trail logs acrossAWSaccounts and region into singe S3 bucket to perform security analysis, track changes toAWSresources, and troubleshoot operational issues and to demonstrate compliance with internal policies and regulatory standards.
- Worked on resource management of security-related and cost-related items usingAWSConfig (to determine the current configuration, to understand the configuration change history, monitor configuration changes for security analysis, audit compliance, change management, troubleshooting and discovery of resources.
- Configured Cloud Front (CDN) with adequate path patterns following best practices for caching objects based on cookies/header forwarding settings.
- Followed best practices to protect against potential DDoS attacks such as SYN flood, UDP flood, HTTP GET flood by using WAF, NACLs, Security Groups, ELB, Cloud Front, Cloud Watch, Deep Security etc
- Migrated 10TB enterprise data warehouse from Teradata to cloud data warehouse AWS Redshift. Migrated category management, sales, merchandising and supply chain (AWS S3, Redshift, IAM, EC2, CloudWatch, Teradata, datastage, EMR, SAP, AS/400).
- Built POC utilizing Apache Spark,AWSEMR/S3, and Redshift migrating sales data from AS/400 to Redshift.
- Well versed to designing solutions on AWS usingEMR, Dynamo,Redshiftand building AWS data pipeline.
- Managing executive Customer relationships and key business stakeholders & delivering IT Strategy & Consulting services
- Implemented CI/CD model using Amazon in house products CodeCommit, CodeBuild, CodeDelpoy and CodePipeLine for both In-place and Blue/Green deployments using multiple deployment configurations.
- Designing advanced search solutions using Elastic Search (ELKStack)
TECHNICAL SKILLS:
- IT Management, Cloud Computing
- Amazon Web Services, VPC,EC2
- DynamoDB, S3,Cloud Formation
- Route53, IAM,AWSData Pipeline
- AWSConfig, Cloud Front,Load Balancer
- Lambda, Python, MS SQLServer,Tableau
- Azure, Data Warehouse, VPN, AWSSDK/CLI
- Elastic Load Balancers, Cloud Formation
- JSON,RDS, Trusted Advisor, EMR
- IBM DataStage, Informatica
- Oracle/DB2/UDB, JavaScript
- TFS,GIT,SSIS/SSAS/SSRS, NoSQL
- SQL, MySQL, Elasticache, Cloud Trail
- PHP, Python, .Net, NAT gateway
- Chef, Puppet, Hadoop, Spark,Scala
- Hive, Jenkins, Bash, Powershell
- Web APIs / HTTP / REST / JSON.
PROFESSIONAL EXPERIENCE:
Confidential, Boston, MA
Sr Architect/Consultant
Responsibilities:
- Designed cost effective, high available and highly scalable solutions in hybrid cloud systems.
- On-Perm applications/servers were successfully migrated to theAWSCloud in line with organization standards and lifecycle process starting from DEV to Prod environments.
- Hands-On experience in for asset configuration and management, logical access control, data encryption, network configuration and management, security, logging and monitoring inAWSenvironment.
- Created anAWSIdentity and Access Management role for specific privileged user with cross-account access to resources inAWSAccount.
- Automated and implemented the Cloud Formation Stacks (JSON Scripts) for creating/administrating theAWSresources like Route 53, VPC, Subnets, Gateways, Auto Scaling, and Elastic Load Balancers, creating DB Instances and many others resources across different Availability Zones.
- Implemented Cost cutting techniques by writing own Cloud Formation Stacks by usingAWS::Auto Scaling - Scheduled Actions and Lambda for shutting-down and starting-up the instances based on the requirement/need.
- Designed and provisioned Cloud Infrastructure server instances, storage, and databases. Fully tested and implemented the Disaster Recovery procedures on theirAWSCloud Infrastructure.
- Built-out fault-tolerant NAT Instances (for routing outbound traffic from EC2 instances in private subnets) using custom monitoring and bootstrap script that update route table programmatically.
- Implemented Custom Cloud Watch Alarm(s) for Scale-up and Scaling-Down the Instances in theAWSCloud using autos scaling.
- Expert in creating custom scripts and applications using theAWSSDK and/or CLI Tools.
- Implemented Auto scaling hooks to bootstrap scripts to take care of updating code and environment specific configuration files (from s3) on EC2.
- Created Data Pipeline Definition templates and configured scheduled data pipeline jobs onAWS.
- Extensively worked on migrating applications like PHP, Python, .Net etc from on premise data center toAWSCloud.
- Configured Highly AvailableAWSS3 endpoint and NAT gateway.
- Responsible for creating DNS records, migrating from other domains and DNS cut over.
- Responsible for deploying SSL Certs acrossAWSELB and Cloud Front.
- Technical point of contact to plan, debug and navigate the operational challenges of cloud computing.
- Migrated 10TB enterprise data warehouse from Teradata to cloud data warehouse AWS Redshift. Migrated category management, sales, merchandising and supply chain (AWS S3, Redshift, IAM, EC2, CloudWatch, Teradata, Datastage, EMR, SAP, AS/400).
- Provisioned AmazonRedshifta fast, fully managed data warehouse simple and cost-effective service to analyze all your data using standard SQL and existing Business Intelligence (BI) tools.
- Worked on developing Scalable AWS (EMR) environment on highly-scalable distributed systems. Allows us bring downEMRcluster any time and bring it back up in very minimal time.
- Built POC utilizing Apache Spark,AWSEMR/S3, and Redshift migrating sales data from AS/400 to Redshift.
- Used Analyze and Vaccum theredshiftdatabase on loading the historical data for theredshiftserver performance and utilization of resources.
- UsedAWSData Pipeline to schedule an Amazon EMR cluster to clean and process web server logs stored in Amazon S3 bucket..
- Tagged AWSresource to identify and categories resources by function, environment, project, platform criteria.
- Followed best practices to protect against potential DDoS attacks such as SYN flood, UDP flood, and HTTP GET flood by using WAF, NACLs, Security Groups, ELB, Cloud Front, Cloud Watch, Deep Security etc.
- Designing advanced search solutions using Elastic Search (ELKStack).
- EstablishedAWStechnical credibility with customers and external parties to help the customers build scalable, resilient, and high-performance applications and services onAWS.
- Implemented CI/CD model using Amazon in house products CodeCommit, CodeBuild, CodeDelpoy and CodePipeLine for both In-place and Blue/Green deployments using multiple deployment configurations.
- Responsible for evaluating architectures using a consistent set of principles.
Confidential, Providence, RI
Architect/Consultant
Responsibilities:
- Designed, orchestrated and built end-to-end solution for cloud migration.
- Launched Amazon EC2 Cloud Instances using Amazon Web services (Linux) and configured the launched instances with respect to specific applications
- Created S3 buckets and managed policies using IAM roles for S3 buckets and used S3 bucket and Glacier for storing historical data.
- Responsible for controlling access toAWSresources usingAWSIAM, MFA, Cross-Account policy.
- Configured and managedAWSGlacier to move longstanding data to archives, based on retention policy of database/applications.
- Implemented Redshift cluster and manage the access.
- Provisioned Database infrastructure (RDS, REDSHIFT and DYNAMO DB) in AWS.
- Developed and maintained Cloud Formation scripts to automate the provisioning ofAWSresources (IAM, EC2, S3, SNS, RDS, ELB and Auto Scaling).
- Migrated SQL database toAWSRDS Multi AZ's.
- Configured aggregation of Cloud Trail logs acrossAWSaccounts and region into singe S3 bucket to perform security analysis, track changes toAWSresources, and troubleshoot operational issues and to demonstrate compliance with internal policies and regulatory standards.
- Worked on resource management of security-related and cost-related items usingAWSConfig (to determine the current configuration, to understand the configuration change history, monitor configuration changes for security analysis, audit compliance, change management, troubleshooting and discovery of resources.
- Working on Data Encryption (Client-Side and Server-Side) and Key management securing data at rest and in transit for data in S3, EBS, RDS, and Redshift etc.
- Reviewed and fixed the security loop holes and applied security at all layers following the AWS's Trusted Advisor.
- Reviewed Backup Process and validated the Backup Restoration time to time.
- Reviewed Storage configuration to understand data characteristics and workload demand.
- Utilized highly availableAWSEnvironment to launch the applications in different regions and implemented Cloud Front withAWSLambda to reduce latency.
- Implemented and monitored alerts of production and corporate servers/storage usingAWSCloud watch.
- Written Chef Recipes to manage deployments and automation of infrastructure.
- Configuration management tool experience with Chef.
Confidential, Philadelphia, PA
Architect/Consultant
Responsibilities:
- Gathered all detailed requirements in one place (from different modules with different technologies) based on business functionality.
- Initiated the cloud environment setup usingAmazonWeb Services and configured VPCs, Cloud Formation, Elastic Beanstalk, Route53, EC2 Instances, ELB, Auto Scaling, RDS, IAM, S3 and other relevant services.
- Responsible for configuring Cloud Front (CDN) with adequate path patterns following best practices for caching objects based on cookies/header forwarding settings.
- Implemented OpenVPN solution to connect remote users toAWSVPC and on premise DC, responsible for administering and maintaining it at all.
- Configured API Gateway and used Lambda Services for BI related operations reporting.
- Used SQS for messaging services between services as well as SNS for notifications.
- ConfiguredAWSElastic Search and Cloud Watch for logging and monitoring instances and application services.
- Delivered the project implementation within a very short time span.
- Responsible for setting up SNS notifications for multiple system events.
- Reviewed and analyzed Network ACLs and Security Groups time to time.
- Automated EBS snapshots job (daily and monthly) based on TAG on EBS volume usingAWS-CLI tool.
- FollowedAWSTrusted Advisor recommendation for optimizing cost, improving systems performance, and closing security gaps.
- Implemented Cloud Watch alarms, Cloud Trail setup, created cloud formation templates and created S3 buckets.
Confidential, Philadelphia, PA
DW Consultant
Responsibilities:
- Designed and Analyzed the ETL process Identified/documented data sources and transformation rules required populating and maintaining data warehouse.
- Analyzed the existing informational sources and methods to identify problem areas and make recommendations for improvement. This required a detailed understanding of the data sources and researching possible solutions
- Involved in complete software development life cycle (SDLC) i.e. Requirement Analysis & Specification, technical design and Implementation.
- Involved in performance tuning and optimization of DataStage mappings using features like Pipeline and Partition Parallelism and data/index cache to manage very large volume of data.
- Interacted with End user community to understand the business requirements and in identifying data sources.
- Created SSIS Packages by using advanced tools (i.e. pivot Transformation, Derived Columns, Condition Split, Term extraction, Aggregations, Multicasting).
- Created Packages by testing and Cleaning the Standardized Data by using tools in Data Flow Transformations (Data Conversion, Export Column, Merge join, Sort, Union all, Conditional Split and more) for existing/new packages
- Developed and modified the existing reports from basic Chart and tabular to parameterized reports including Single/Multi/Boolean valued parameters and linked reports based on new business logic.
- Developed complex stored procedures using T-SQL to generate Ad hoc reports within SQL Server Reporting Service (SSRS).
Environment: IBM Information Server V8.1(DataStage, QualityStage, Information Analyzer), Oracle 11g,SQL Server 2008,Flat files, Sequential files, ESP, AIX UNIX, SSIS,SSRS,PL/SQL, DOS and UNIX Sequential Files
Confidential, Chattanooga, TN
DW Consultant/System Analyst
Responsibilities:
- Designed and Analyzed the ETL process Identified/documented data sources and transformation rules required populating and maintaining data warehouse.
- Analyzed the existing informational sources and methods to identify problem areas and make recommendations for improvement. This required a detailed understanding of the data sources and researching possible solutions
- Used Data Stage Designer extensively to design and develop extraction jobs, transformation jobs, and Load jobs.
- Developed Parallel jobs using Stages, which such as Aggregator, Join, Transformer, Sort, Merge, Filter and Lookup and Change capture.
- Have written complex jobs to process insurance claims which would require numerous look ups and joins.
- Implemented complete life cycle of qualitystate which includes investigating, standardizing, matching and surviving
- Written different kind of match pass so as to match the data consistently across various platforms
- Created shared and local containers to simplify and modularize server job designs by replacing complex areas of the diagram with a single container stage, moreover as a way to in corporate server job functionality into a parallel stage
- Have developed Job sequencers using various stages like JobActivity, Sequencer, Routine Activity, Wait For File Activity, Nested Condition, Exception Handler and Notification Activity
- Experience with Reporting tools such as cognos for developing Models and complex reports.
- Created SSIS Packages using Pivot Transformation, Fuzzy Lookup, Derived Columns, Condition Split, Term extraction, Aggregate, Execute SQL Task, Data Flow Task, and Execute Package Task etc to generate underlying data for the reports and to export cleaned data from Excel Spreadsheets, Text file, MS Access and CSV files to data warehouse.
- Implemented slowly changing dimension (SCD) using in SSIS.
- Generated reports using SQL Server Reporting Services 2005/2008 from OLTP and OLAP data sources.
- Designed and deployed reports with Drill Down, Drill Through and Drop down menu option and Parameterized and Linked reports.
- Deploying and scheduling Reports using SSRS to generate all daily, weekly, monthly and quarterly Reports including current status.
- Prepared the Layouts by placing the fields to the appropriate place according to the requirement of the final Report.
Environment: IBM Information Server V8.1(DataStage, QualityStage, Information Analyzer, Metadata work bench), Oracle 10g,SQL Server 2005/2008, DB2 UDB, Flat files, Sequential files, ESP, AIX UNIX, IBM Cognos 8.0 framework, Report studio, SSIS,SSRS,T SQL,PL/SQL, DOS and UNIX Sequential Files, MS Access, Mainframe
Confidential, Auburn Hills, MI
Data Warehouse Consultant
Responsibilities:
- Identified and documented the Data source and target along with the data mapping rules and transformations
- Used DataStage Designer extensively to design and develop extraction jobs, transformation jobs, along with the jobs to load the transformed data
- Developed Parallel jobs using Stages, which such as Aggregator, Join, Transformer, Sort, Merge, Filter and Lookup and Change capture.
- Wrote numerous custom routines and transforms for various specifications such
- Used the DataStage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting executable versions (on an ad hoc or scheduled basis).
- Have developed Job sequencers using various stages like JobActivity, Sequencer, Routine Activity, Wait For File Activity, Nested Condition, Exception Handler and Notification Activity
- Developed various UNIX shell scripts to run jobs, sequencers along with other Enterprise Applications in Java.
- Created Error Files and Log Tables containing data with discrepancies to analyze and re-process the data.
- Documented the ETL process so to facilitate an understanding of the entire ETL process and in corporate changes as and when needed.
- Created User guides for the production team so as to facilitate an understanding of the Daily ETL process and its dependencies
- Involved in the knowledge transfer to business users to enable them to maintain the application
Environment: Ascential Data Stage 7.5, Parallel Extender, (Designer, Director, Manager), Sun Solaris 5.8,oracle 9i, PL/SQL, Pearl, DOS and UNIX Sequential Files, MS Access, Autosys, Mainframe
Confidential, Dallas,TX
Data Warehouse Consultant
Responsibilities:
- Used various built in functions supported by oracle such as Character, Date,
- Conversion, Numeric, LOB, and other Miscellaneous Functions
- Written Complex cursors involving Variables, Parameters, attributes and select for updates and more over have also written Stored Procedures, functions and was also involved in Module Overloading.
- Written Packages which involved Cursors, Variables, Constants, Exception names,
- PL/SQL table and record TYPE statements, Procedures and Functions and have
- Also Created objects, manipulated objects, created collections and was also involved In modifying persistent objects.
- Used the DataStage Manager for importing metadata from repository, new job categories and creating new data elements
- Used DataStage Designer extensively to design and develop extraction jobs, transformation jobs, along with the jobs to load the transformed data
- Proficient in performing various Data conversions using the built-in Transforms, SDK transforms, Functions and System variables
- Wrote numerous custom routines and transforms for various specifications such
- As Date conversions, files based operations such as splitting and moving theFile and string conversions
- Enhanced the performance using standard techniques not only in DataStage but also in database
- Implement the batch architecture for a set of jobs at both the batch job level as well as at the individual jobs level.
Environment: Ascential Data Stage 7.0, Parallel Extender, (Designer, Director, Manager), Sun Solaris 5.8,oracle 9i, PL/SQL, Pearl, DOS and UNIX Sequential Files, MS Access, IBM Tivoli Workload Scheduler 8.2
Confidential, Jersey City, NJ
DataStage Consultant
Responsibilities:
- Created both conceptual and logical data model.And have converted the logical Data model to physical Data Model using Erwin.
- Used the DataStage Manager extensively for importing meta data definitions
- Used DataStage Designer to create jobs to Extract Data from various heterogeneous Sources such as mainframe, oracle and SQL server.
- Have developed Job sequencers using various stages like JobActivity, Sequencer, Routine Activity, Wait For File Activity, Nested Condition, Exception Handler and Notification Activity
- Developed various UNIX shell scripts to run jobs, sequencers along with other Enterprise Applications in Java.
- Worked extensively in PL/SQL. Wrote stored procedures, functions, cursors, packages and Triggers.
- Developed and implemented Universes by defining joins, cardinality between tables, creating prompts and queries, applying contexts and alias tables to remove cyclic dependencies and worked on linking of the Universes using Business objects Designer
- Created, modified, and maintained the business complex reports using Business Objects reports module
- Extensively used calculations, variables, filters, conditions, breaks, sorting, drill down, slice and dice, Master/Detail, Cross Tab, Charts and alerts for creating Business Objects reports
- Documented the complete ETL process so to facilitate an understanding of the entire ETL process and in corporate changes as and when needed.
Environment: Ascential Data Stage 7.0, Parallel Extender, (Designer, Director, Manager), Business objects 6.5,Windows NT 4.0,Sun Solaris 2.6/2.7, IBM AIX 4.2/4.1,Oracle 9i, SQL Server, PL/SQL, Mainframe, DB2, Cobol, JCL, DOS and UNIX Sequential Files.
Confidential
Developer
Responsibilities:
- Involved in creation of Tables using storage parameters and clusters.
- Coded many generic routines (as functions), which could be called from other procedures.
- Developed user interface screens, Master detail relations and Report screens.
- Developed various Reports for the end user as per their requirements and created many reports to suit preprinted format of the company.
- Did Front-end coding and also created Record groups, Libraries and menus.
- Developed complex Forms and Reports using Oracle tools.
- Wrote stored procedures, Functions and Database triggers using PL/SQL.
- Conducted sessions for the end-users.
Environment: Oracle 7.x/8.0, Forms 4.x/8.0, Reports 2.x/3.0, PL/SQL, SQL, MS Office, Windows 95/98.