We provide IT Staff Augmentation Services!

Aws Architect /bigdata Architect Resume

3.00/5 (Submit Your Rating)

SUMMARY

  • Over 16 plus years of IT experience focusing on AWS Architect, Big Data Architect, On - Premise to AWS Migration, Data Analysis, Database Management and Administration with experience in the Banking, Healthcare, Telecommunication, Public utility and financials industry as Architect, Database Manger, Database SME (Subject Matter Expert), DBA and Data Analyst.
  • Have expertise in Big Data, BI/Analytics and data integration, be detail oriented, think strategically, and possess a strong work ethic
  • Implemented and Migrated Oracle, Big Data systems and data warehousing environment in a distributed cloud environment
  • Design and implement scalable Big Data architecture solutions for various application needs
  • Gather requirements from business and perform solution designing and analysis
  • Excellent experience in SPARK, SQOOP/Kafka/Flume/HBase/Hive for extracting near real-time streaming data & event messaging and processing.
  • Install, configure, and monitor system services including HDFS, Yarn, HBase, Flume, Sqoop, Spark, Pig, Hive, etc
  • Excellent working experience in Dataframes, Datasets and RDDs in Scala
  • Strong knowledge in cluster management in YARN, MESOs cluster management
  • Strong knowledge in different file and data handling in formats such as Avro, Parquet, csv. Etc
  • Applying machine learning algorithms (K-means, MLlib, Decision Trees, Linear and Logistic Regression, SVM, Clustering) in order to identify the most significant features across different datasets
  • Programming knowledge in C, Scala and Python
  • Experience in configuring and migrating to AWS cloud and Oracle cloud computing
  • Extensive knowledge in AWS services like Database Migration Service, Glacier, S3, RDS, DynamoDB, EC2, Redshift, EMR, Lamda, Cloudwatch, Cloudtrail, Cloudformation, Route53, VPC, IAM, SNS, SQS and Athena
  • Worked with software methodologies such as Waterfall, Agile, DevOps and SCRUM in delivering new cloud platform services and components
  • Very good knowledge in ETL tools like SAP BODS (BODI), Data Stage and IBM data lineage tool IGC
  • Experience and knowledge in visualization tools like Tableu, Zeppelin, SAS, Splunk and BOXI
  • Very strong performance tuning experience in Spark environment, SQL and NoSQL databases
  • Excellent understanding in order of joins, manage partitions, replication, coalesce, caching, outliers, dataskew and bucketing
  • Knowledge in using debugging tools like Log4J, Spark UI, Yarn UI and Query UI
  • Excellent understanding in analysing tables with statistics
  • Good exposure in Graph Analytics in GraphX algorithm
  • Excellent experience in data processing, batch processing, shell scripts, cronjobs and jobs scheduling
  • Data Governance and Develop, implement data cleansing, data security, data profiling and data monitoring processes.
  • Analyse data and industry models as needs require using CA Erwin data modelling tool. Vertical/Horizontal Database Scaling
  • Design, development, and implementation of large, complex database systems supporting one or more business and/or technology areas, including OLTP and Data Warehouse.
  • Excellent knowledge in data warehousing environment and designed and maintained around 200 production, test and development databases
  • PLSQL, CSS, Java scripting experience in Oracle application express
  • Responsible for Oracle product code base, upgrades to new Oracle versions, development of processes and procedures.
  • Evaluation of fixes, patches and security vulnerabilities for new Oracle version and ability to determine currency requirements
  • Very good knowledge in Blockchain concepts and Crypto coding
  • Excellent communication skills and customer relationship

TECHNICAL SKILLS

Big Data Frame work: Spark, Hadoop, Sqoop, Kafka, Flume, HBase, Pyspark, Map Reduce, Storm, Hive, Pig, Spark Streaming, Spark SQL, MLlib, GraphX, Yarn, Zoo Keeper and Spark R

Operating system: Mac Os, Unix, Linux, AIX and Windows

Programming Languages: Scala, Python, C, C++, Pascal, Unix Shell Scripting, PLSQL, VB and Oracle Apex

Databases: Oracle, SQL Server, Mongo Db, Cassandra, HBase

Visualisation Tools: Tableu, Zeppelin, SAS and BOXI

Cloud Technologies: AWS Database Migration Service, Glacier, S3, RDS, DynamoDB, EC2, Redshift, EMR, Lamda, Cloudwatch, Cloudtrail, Route53, VPC, IAM, SNS, SQS, Athena, CloudFormation and Oracle Cloud computing

Tools: Eclipse, IntelliJ, Scala IDE, Pycharm, Ansible playbook, Toad, SQL Developer, Remedy, Service Now, ERWIN Data modelling, Cronjobs (Scheduling), Control-M, Spark UI, Query UI, GitHuB, Maven (for automation), Jenkins

PROFESSIONAL EXPERIENCE

Confidential

AWS Architect /Bigdata Architect

Responsibilities:

  • Consulting Big Data environment migration to AWS environment
  • Participating in the various stake holder meetings and understanding the requirements
  • Provided initial architecting plan for the solution with the minimal cost and optimized plan

Confidential

AWS Architect / Big Data Architect

Responsibilities:

  • Implemented large scale complex programs / applications within the bank to satisfy the analytics and Management information requirements
  • Participated in various stake holder meetings and business to gather requirements
  • Architecting the solution best for the RDBMS environment to initial Big-Data environment
  • Involved in cluster management, resource management, profiling the various requirements for the BigData implementation
  • Involved in early estimation, planning, managing and implementing the BigData and AWS Solutions
  • Migrated oracle, data warehousing and big data environments into AWS
  • Implemented complete a new Big Data setup and migrated them over to AWS cloud within the bank, involving various possible options with low cost impact
  • Suggested the High Performance and scalable environment with minimal manual intervention
  • Automated various requirements using spark streaming for the real time processing
  • Involved in various challenging tasks (explored various options) in handling high volume and complexities relational data into big data environment
  • Ensured the product(s) adhere to target reliability, availability, scalability, performance, and security goals/targets
  • Implemented various machine learning algorithms and predictive analysis required by the management
  • Optimize and automate data ingestion, data processing and distribution data from variety of sources, including click stream data, mobile texting, ratings data, advertising data, web data, 3rd party sources and text files / excel files from the business
  • Design, develop, test, and continuously improve performance of Hadoop/Spark based solutions
  • Own the end-to-end development life cycle with high quality of solution/code you develop and evangelize the test-driven development approach
  • Displays strategic thinking and come up with sustainable solutions that span across projects and platforms keeping an eye towards simplicity, reliability, manageability, scalability, extensibility, high performance and re-usability
  • Involved and supported in throughout the journey of the project from planning, analysing, designing, developing, testing and implementation
  • Involved in high volume data management, variety of data from different sources, data quality, data insight in various projects
  • Monitored and optimised the performance by using Query UI, Spark UI and YARN UI tools and suggested the changes required for the joins and implementing partition, repartition and bucketing
  • Suggested and implemented the visualisation tools required as per the project requirements such as Tableu, BOXI and SAS Reporting
  • Created conceptual, logical and physical data model for the projects
  • Worked with data management team for data integration, date quality, data profiling to integrate, transform and improve valid data
  • Worked alongside with data scientists, Big insights team, Big match team

Confidential

Senior Data Architect / Datawarehouse Architect

Responsibilities:

  • Gathering the project requirements from business
  • Working closely with business to transform the functional requirements into technical
  • Liaise with solution designers, business analysts to analyse and articulate detailed data requirements and data mappings by analysing business requirements
  • Support business requirements definition with data analysis activities (e.g data profiling, data mining. Etc) to inform requirements capture and design approach as well as validate data quality where applicable
  • Interpreting data, analysing results using statistical techniques
  • Data mapping and integration analysis between source and target
  • Design the models, algorithms and visualizations that help companies’ insights from huge volumes of chaotic data
  • Developing and implementing data analysis, data collection systems and other strategies that optimize statistical efficiency and quality
  • Acquiring data from primary or secondary data sources and maintaining databases
  • Data profiling, Data mining and Data Quality analysis
  • Develops strategies for data acquisitions, archive recovery, and implementation of a database
  • Conducting full lifecycle analysis to include requirements, activities and design
  • Review team processes and procedures to identify continuous improvements
  • Understand the data flow and identify the impacts of changes requested by the project
  • Developed product requirements based on input gathered from variety of sources including analysis results and feedback from the user community
  • Developed test conditions and expected results based on the application requirements
  • Reviewed project deliverables for completeness and quality, and compliance and established project standards
  • Highlight data quality issues

Confidential

Big Data Solution Architect

Responsibilities:

  • Successfully implemented a project to migrate the traditional data ware housing environment to Big Data environment
  • Involved in Solution architect phase of the project and provided a best solution method for the environment
  • Involved in early engagement with the vendor and done well balanced environment for both RDBMS and Big Data Analytics platform
  • Involved in designing the analysing the requirements of the project
  • Implemented a new AWS cloud platform

Confidential

DBA Manager / SME

Responsibilities:

  • Managed around 30 resources across ETL, Oracle DBA and UCM technologies and handled more than 10 projects as a technical build lead
  • Ensured that on time and quality product delivered to client and managed end to end for database migration and upgrades projects
  • Ensured that accurate project metrics captured and reported every week
  • Extended technical help to the team for L3 / L4 issues in DBA space which could not resolved by the DBA team
  • Worked on 12c Upgrade for the 11g and 10g database
  • Administration and Management of Oracle 12c RAC (real application cluster) system from design architecture to Replication implementation
  • Experience migrating the VMWARE environment to EXADATA systems
  • Implemented high availability feature data guard for availability, performance and maximum protection
  • Ensured 400+ development databases are up and running fine
  • Ensured that the development projects assigned are following all the necessary standards and processes
  • Designed and implemented the backup strategy with RMAN and Flashback technology
  • Configured Oracle Enterprise Manager Grid control/Cloud control for monitoring to manage and automate the alerts based on thresholds
  • Bridging gap between the delivery team and build team
  • Highlighted the issues and risks on time to delivery team
  • Tracked the build progress and presenting to the leadership team
  • Highlighted the design changes in the build space to ensure that CRs are raised
  • Arranged the various trainings to enhance the technical and functional capability across the team
  • Ensured that team is engaged always even when they are in downtime
  • Acted as a Technical Team lead for Development DBA's and SME for the production support team
  • Bridging between Onsite and Offshore team for the project requirements
  • Ensured that team is on top of fixing the database issues on time, like database backup and recoveries, cloning and performance related issues.
  • Supported team and worked on L4 tasks like upgrade/migration/cloning/performance tuning and database critical issues
  • Built the technical capability team and improved the technical proficiency for the team
  • Worked in ERWIN data modeller tool and created conceptual, logical and physical models
  • Arranged technical forums to improve the team proficiency
  • Ensured the team is focused and motivated to deliver the quality scripts for SAP BODS ETL, PLSQL and UCM and BOXI technologies
  • Ensured the team is delivering the projects defect free, QA reviewing their scripts and making the standards implemented in the scripts/ playbooks
  • Provided estimation / timeline for the new projects.
  • Liaised with clients to understanding the issues in delivery and to meet the time
  • Supported for the RFP (Request for Proposal) creation for the new account signup
  • Worked as architect for new 12c database projects
  • Created Data Models in concepts like Star-Schema Modeling, Snowflake Schema Modeling, Fact and Dimension tables
  • Participated in various requirements, design and technical workshops with client team
  • Experience in IGC data lineage tool, Remedy ticketing tool, Quality Center defect management tool, RTC project delivery tool, EPM and MPP project management tool
  • Created the ETL architecture and provided strategy related to data cleansing, data quality and data consolidation
  • Interacted with the business users on regular basis to consolidate and analyze the requirements and present them the design results
  • Analyzed the existing systems and the business user requirements for tactical and strategic needs
  • Worked with business users to analyze requirements, standards, presentations and documents

Confidential

Database Administrator

Responsibilities:

  • Acted SPOC to the clients and managing the DBA team
  • Prepared and sending on time daily / weekly / monthly status Report to the clients
  • Participated service / delivery enhancement / account update meetings with clients
  • Worked as DBA technical team lead
  • Responsible for, both manage and support all Production, Development and Test instances of Oracle Version 8i, 9i and Oracle 10g
  • Maintained the databases 24x7 production environment
  • Monitored and troubleshoot various databases remotely for database located in UK, France & Germany
  • Maintained data integrity and tune database for optimum performance and availability. Excellent in troubleshooting Oracle issues
  • Ensured successful & periodical Backup, Restoration & Tuning
  • Backup and recovery using RMAN, change management, Data Modelling, scripts for various database activities, troubleshooting etc
  • Written shell scripts for monitoring the databases regarding the status, performance and Space Management and health checks
  • Installed and administer Oracle Products
  • Provided technical support and assistance to all database end-users
  • Installed the Patches and fixed bugs whenever required
  • Experience in SQL and Database performance tuning
  • Planed for system growth and monitor capacity usage for new hardware or software requirements and communicate these capacity requirements to management
  • Acted as liaison to interact with the database vendors
  • Liaised with clients, change control teams, Net backup team, Unix team & 2line support team for implementing the successful changes
  • Arranged outage for the databases for the patch upgrades and changes
  • Handled more than 100 databases in 10 servers (Windows, Unix, Sun Solaris) more than 800GB of DB size
  • Handled and administered Oracle 10g RAC environments
  • Performed the disaster recovery testing in frequent intervals
  • Implemented and supported Data guard environments and performed the failover testing
  • Upgraded older versions 8i,9i databases to Oracle 10g
  • Handled the web servers and load balancing servers

Confidential

Database Administrator

Responsibilities:

  • Worked as SPOC to the clients and managing the DBA team
  • Maintained and supported Oracle 10g RAC environments
  • Prepared and sending on time daily / weekly / monthly status Report to the client
  • Participated service / delivery enhancement / account update meetings with clients
  • Responsible for team management
  • Monitored the database loads and its health
  • Server Migration from data centre at client sites in the UK
  • Arranging and implementing the Monthly housekeeping activities
  • Arranging and implementing CR (Change Request) activities
  • Handling the year end migration activities in Data centre at client location
  • Suggested the clients to upgrade the database where it is necessary
  • Providing the plan for upgrading the databases and timelines to the client
  • Getting the approval and performing the service improvement plans
  • Ensured the team incidents / Service Requests / service calls not breeching its SLA's.
  • Migrated older versions to Oracle 10g
  • Implemented Automatic Storage Management in existing database
  • Liaised with the clients based on Poland and France and helping them to meeting the database requirements by consulting the oracle products
  • Worked on database cloning whenever it required for the development databases from production or from the testing environments
  • Supported for the server outages and performing DBA related activities

Confidential

Database Administrator

Responsibilities:

  • Managed the remote DBA team
  • Maintained the databases 24x7 production environment
  • Supported various Oracle flavours from Oracle 7 to 10g
  • Cloned the databases whenever required from other instances
  • Upgraded older versions to 10g
  • Arranged the outages and implementing patch upgrades
  • Ensured successful Periodical Backups Completed successfully and updated the backup strategy when it’s necessary
  • Worked on database restoration & tunings
  • Written scripts to automate database functions
  • Backup and recovery using RMAN, change management, Data Modelling, scripts for various database activities, troubleshooting etc
  • Written scripts for sending mails/messages to DBA's regarding the status, performance and Space Management of the Database
  • Installed the Patches and fixed bugs whenever required
  • Liaising with clients, change control teams, Net backup team, Unix team & 2line support team for implementing the successful changes
  • Arranged outage for the databases for the patch upgrades and changes

We'd love your feedback!