Big Data Architect Resume
SUMMARY
- Technology leader with more than 14 years of diversified experience in Architecture, Design, Manage, and Implementation of highly reliable and scalable distributed Enterprise applications using Hadoop, Java & Machine learning technologies.
- More than 5 years of technical management experience in execution and delivery of software development solutions.
- Strong experience in recruiting, strategic planning, performance, project management, mentoring/coaching team, Architecture, technical implementation, defining roadmap for project and team.
- Primary responsibilities include, but not limited to, technical direction on building customer focused and scalable software applications, overseeing agile software development process, working with various stakeholder (PMO, TPM, UX, Business Leads) on requirement/design/integration of software components.
- Lead multiple technical teams of software developers in planning, directing, executing and overseeing the entire software development process. Strong experience improving existing software as well as developing new ones.
- Experience working on multiple technology and hands on experience on multi - tiered, Lambda & Microservices architecture using Java, Hadoop and Machine learning technology.
- Experience on framing architectural decisions, providing leadership, direction, strategy, vision in the areas of technology and product development to facilitate and enable growth for business agility.
- Experience building team of engineers from scratch, leading and growing talent within teams, taking full system ownership to deliver end to end implementation with great talent. Experience working with Vendor and Onsite/offshore model.
- Experience extending the team from 8 to 18 engineers for highly scalable products and platforms and new initiative. Proven excellence in making effective hiring decisions, building high performance teams, annual compensation, yearend reviews and promotions.
- Designed, developed and delivered valuable and business critical solutions, including highly available and scalable including cloud based application using Java, Hadoop, HDFS, HBASE, HIVE, Cassandra, Kafka, Spark, Spring, jQuery, Knockout, YUI, Apache Solr, AJAX.
- Experience working with Health Care, Insurance, Real estate & Ecommerce, Entertainment domain.
- Extensive experience in Requirement analysis, User requirement document (URD), Design specifications, data modeling, technical design document, program specifications, and Functional Specification documents.
- Leadership quality with strong analytical, problem solving, interpersonal, quick learning, team management skills.
- Experience bringing new technology from open source according to business use case and developed POC for stake holder presentation. Prepare and conduct presentation on system architecture, solution and requirements to executives and cross functional team members
- Experience in Identification/implementation of the machine & deep learning algorithms for the business use case.
TECHNICAL SKILLS
Leadership: Resource Management, Project Management, Process, SOW & Vendor Management, Risk Management
Machine Learning & Deep Learning: Classification, Regression, Clustering, Ensemble Learning and Neural Network
Big Data & Search: - Hadoop, MapReduce, Hive, Pig, Sqoop, Spark, Spark SQL, Hbase, Kafka, Oozie, Solr, Elastic Search
Packages and Programming Languages: Python (NumPy, SciPy, Pandas, Matplotlib, Seaborn, SciKit, TensorFlow, NLTK, ggplot), MLlib, AWS, Scala,Java, J2EE, SQL, JSP, Struts, Spring, Spring web services(Rest), Spring boot, JIBX, JAXB, PLSQL,XML, SolrJ, WebSphere MQ, JMS, Log4j, Scala
Web Technologies: JavaScript, HTML, XML, CSS, XSLT, YUI2/3, JQuery, JSON, AJAX, Knockout
Application Server: WebLogic 10.3/ 11g, Jetty, IIS 5/6/7, JBOSS, Apache Tomcat
Database Systems: Oracle, SQL Server, MySQL, NoSql
Domain: Ecommerce, Real Estate, Mortgage, Insurance, Health care, Entertainment
Software: - Microsoft Office, Microsoft Project, Microsoft Visio
Version Software: SVN, Microsoft Visual Source Safe 6.0/2005, TFS 2008, Git
Design/Process: OOAD, Design Pattern, SDLC Agile, Scrum(Scrum Master/ Product Owner), Waterfall
PROFESSIONAL EXPERIENCE
Confidential
Big Data Architect
Responsibilities:
- Architect & Manage various projects to develop core data platform, and essentially, the "single source of truth" for Molina
- Leading Bigdata Architecture efforts towards building data lake including data ingestion, data curation which will be used for Business analytics.
- Framing architectural decisions, providing leadership, direction, strategy and vision in the areas of technology and product development to facilitate and enable growth and business agility.
- Brought in coding standard, process and best practices/guidelince for the department.
- Management and execution against project plans, delivery commitments, day-to-day activities of the engineering team within a Scrum environment
- Architect & Build Data foundation Repository for various symentic layers on data ingestion, data curation and consolidation.
- Driving architectural effort for OnPremises to Azure cloud migration
- Managing team of Onsite & OffShore engineers to deliver Semantic layers.
- Developed and presented predictive analytics POC & data insight for member churn usecase.
- Weekly leadership status updates on Initiatives, development, data quality, performance and roadmap.
Environment: HDFS, HBASE, Oozie, Spark, Spark SQL, Scala, Hive, Impala, Cloudera, Talend, Solr, Python, NumPy, SciPy, Pandas, Matplotlib, Seaborn, SciKit-learn, Visio, Azure Cloud
Confidential, CA
Big Data Architect
Responsibilities:
- Architect & Manage various projects related to Confidential ’s Guide metadata including Data Ingestion(from various sources), Data Enrichment/Process and Data publish(Serve and Search) using Big Data, Solr & Java technologies.
- Architect & Manage Confidential ’s Next generation Recommendation Engine for user personalized content using Big Data, ML & DL library. Technically deep dive on design and mentor team on project implementation.
- Framing architectural decisions, providing leadership, direction, strategy and vision in the areas of technology and product development to facilitate and enable growth and business agility.
- Experience building team of engineers from scratch for metadata project, Full program ownership of the project to deliver end to end implementation with great talent of Lead and junior engineers.
- Experience in gathering requirements with business stake owners, leading technical projects, define the scope and discuss challenges/issues/design concerns across multiple teams to ensure smooth solution implementation.
- Managed & optimized Confidential ’s Legacy cloud based Applications to reach high TPS and scalable system which eventually get used by millions of customers through Mobile, Web and STB.
- Brought in many architectural changes to use No SQL DB, Solr, Hadoop and light weight messaging such as Kafka
- Designed and Developed Application using Lambda Architecture including Big data and MicroServices for Data Ingestion, Data Processing and Data Publish.
- With the large volume of structure and unstrcture data, Key player to determine new business use cases/solve business challenge by applying best technology stacks across the department for upsell marketing, EST Programs.
- Experience converting Vision to reality by developing POC to production ready application for Data Enrichment. With the focus of customer satisfaction and business ROI, delivered the system which eventually saved millions of dollar in terms of hardware and man hours.
- Architect & Design Batch/Near real time ingestion to HDFS using Spark Streaming, Kafka.
- Experience applying data science project life cycle, including Data Acquisition, Data Mining, Data Wrangling, Feature Engineering, Modelling, Evaluation, Optimization, Testing for Structure and Unstructure data.
- Identify and coach team on applying the Machine learning model according to business use case like classification & clustering.
- Developed POC using datadriven framework Apache Nifi (Ni-fi) for data ingestion.
- Manage multiple project simultaneously as well as lead the team onsite and offshore to achieve deliverables.
- Involved in user requirements,analyzing usecases, feasibility study, designing High & Lowlevel document, change requests, and providing estimations.Helped to solve systems architectural problems across department.
- Manage project on Migration path for Cloudera (CDH) based Hadoop environment to Hortonworks
- Established development guidelines and process, enforcing mandatory unit test coverage, performance benchmarking with automation (CICD).
- Experience working in agile methodology including sprint planning, sprint procedure for sprint deliverables.
Environment: Java, J2EE, JDK 1.8, JSP, Spring 3.0, Spring MVC, XSL, XML, Mysql, Oracle, Eclipse, Hibernate, Spring Webservices, REST, EJB, JBOSS, Apache tomcat, Apache Solr, HDFS, HBASE, Oozie, Kafka, Spark MLlib, Scala, S3, docker, Hive, PIG, Map Reduce, AWS, Cassandra, Morphline, Hbase/Lilly Indexer, Maven,Python, NumPy, SciPy, Pandas, Matplotlib, Seaborn, SciKit-learn, TensorFlow, Keras, NLTK, ggplot, Crucible, Start UML, Visio
Confidential, CA
Lead Java Developer
Responsibilities:
- Experience in product development life cycle starting from translating business requirement into product implementation through architectural design, development, testing, delivery.
- Lead and mentor junior team members on fuctionaity and implementation. Define the process for peer reviews, Code reviews and code deployment workflow.
- Involved in developing Message Driven Beans (MDB) using JMS used in the application and constructing messages to transport results/orders between systems asynchronously,
- Developed UI through knockout and YUI3 frameworks. Developed Drag & Drop widget using Knockout & YUI3.
- Extensive use of AJAX technology to interact with controllers/actions to get the instant response.
- Experience in Spring Rest and SOAP Web Services to fetch application data using SOA architecture.
- Hands-on experience in developing Ant scripts for continues integration and deployment process
- Developed Oracle packages, views, triggers and stroed procedure.
- Coordinating with the onsite, offshore and QA teams to facilitate the quality delivery from offshore on schedule.
- Developed Solr module using lucidworks platform to provide quicker response time for service.
Environment: Java, J2EE, JDK 1.6, JSP, Spring 2.5, Spring MVC, Sterling web channel, Knockout, YUI3, JQuery, XSL, XML, DHTML, JIBX, JAXB, Oracle 11g, Eclipse, Struts 2, Hibernate, Spring Webservices, EJB, ilog rules, Oracle Weblogic Server 11gR1, OSB, iNexx, Apache Solr(Lucidworks), Weblogic JMS, MQ visual Edit, TFS 2008, Selenium, JMeter
Sr. Java Developer
Confidential
Responsibilities:
- The project was running parallel with Panther project below. I have multiple responsibility for both of the project. One is more towards team and project management and second, which lead and develop end to end solution.
- Utilized Spring MVC framework to implement design patterns like IOC (Dependency Injection), Spring DAO (Data access objects), Data Transfer objects, Business objects.
- Extensively used Spring IOC architectural model to inject objects based on the selection of components like setter injection and Interface injection to manage the object references.
- Prepared and executed JUNIT test cases to test the application service layer operations before DAO integration
- Coordinating with the onsite, offshore and QA teams to facilitate the quality delivery from offshore on schedule.
- Involved in Requirements Collection, Design & Analysis of the Customer Specifications, Development of the Application. Involved in troubleshooting the Application and also done extensive Code Reviews.
- Lead and mentor junior team members on fuctionaity and implementation.
Environment: Java, J2EE, JSP, Spring 2.5, JQuery, XML, DHTML, JIBX, Oracle 9i, Eclipse IDE, Hibernate, Oracle Weblogic Server 10, SVN