We provide IT Staff Augmentation Services!

Bigdata Architect Resume

3.00/5 (Submit Your Rating)

TX

SUMMARY:

  • BigData Architect/Lead Developer with 15+ years of professional experience involving architecting, designing, developing & deploying solutions around Data warehousing, Business Intelligence, Advanced Analytics and Web applications.
  • Strong analytical, problem solving and troubleshooting skills, willingness, and ability to quickly adapt to new environments and learn new technologies.
  • Extensive experience in working with BigData Applications.
  • Expertise in designing and developing Analytics with Spark/Scala.
  • Extensively worked on ETL and Legacy Systems to Hadoop migration.
  • Over 5 years of experience developing Big data solutions using technologies like MapReduce, Apache Spark, Pig, Sqoop, Oozie, Flume & Kakfa, extracting or loading data into HDFS, HBASE and Hive .
  • Exposure to Tableu and NoSQL DBs.
  • Vast exposure to EDW , Telecom, TV Viewership, and TV program data .
  • Vast exposure to Healthcare data and reports .
  • Extensively designed and developed Snapshot, Data compression and Data lookup processes.
  • Improved performance of Spark/Hive jobs.
  • Helped Clients on how to get more out of the Data .
  • Vast exposure to Billions of records and lots of data.
  • Expertise in working with HortonWorks Data Platform.
  • Experience with AWS Cloud.
  • Exposure to Cloudera distribution.
  • Experience with Teradata .
  • Expertise in developing applications using Java, J2EE, Spring/MVC, Hibernate, SOAP & Restful web services, JMS, JSP, Servlets, XML, JAX - WS/JAX-RS, JNDI, JDBC, HTML, JavaScript, and SQL.
  • Experienced in using agile approaches including Extreme Programming, Test-Driven Development, and Agile Scrum.
  • Expertise in working with Oracle and SQL Server.
  • Familiarity with Python.
  • Excellent interpersonal skills backed up-by-sound professional ability to work independently as well as a team member.
  • Highly organized and dedicated with positive Attitude, possess good time management and organizational skills with the ability to handle multiple tasks with positive attitude
  • Possess effective command over written, verbal communication and presentation skills.
  • Experience with Onsite and Offshore models.
  • Helping Developers on Best practices and Code reviews.

TECHNICAL SKILLS:

Operating Systems: UNIX, Linux, and Windows

Programming Languages: Java, SQL, Scala, Python and Shell scripting

Big Data Technologies: Spark and Spark Streaming, HDFS, MapReduce, Apache Spark,Hive, Pig, Sqoop, Flume, Oozie, Avro, Orc and Kakfa.

Big Data Bundles: HortonWorks ( HDP )

Cloudera Distributions

JSPS, JNDI, JDBC, Spring, Hibernate JAX: WS/Web Services and Restful services.

GUI Technologies: HTML/HTML5, CSS, Java Script, Ajax and JQuery

RDBMS: DB2 8.2, Oracle 10g, SQLServer and Teradata.

Application Servers: JBoss, Tomcat and WebSphere

DATA/XML technologies: JAXB, JAXP and XML.

Development Tools: Confidential RAD, My Eclipse, Eclipse, and Rational Software Architect 6.0

ORM: Hibernate

Source Control: Git, SVN and VSS

Reporting Tools: Jasper Server Reports and iReports designer

Other tools: McKesson InterQual Cerme, CareWebQI and Kwik Tags. JIRA,Splunk, Test Director and Change Point STB

Cloud: AWS

PROFESSIONAL EXPERIENCE:

Confidential, TX

BigData Architect

Responsibilities:

  • Responsible for migration of Legacy ETL Scripts to Hadoop.
  • Design and Develop Ingestion Framework for various source systems using Hadoop Technologies.
  • Design and Develop Extracts from DataLake for users using Python, Hive, PIG, Sqoop, HBase and Batch processes.
  • Designed and Developed TV Viewership projection for DIRECTV using Spark and Scala.
  • Designed and Developed RESTFul web services to bring the data from HTTP sources using Spring, Spring MVC, Spring REST and Tomcat.
  • Developed data pipelines in Spark/Scala.
  • Designed and Developed Real time streaming with Kafka for Data replication from other servers.
  • Designed/Developed framework to pull/load files from/to Amazon S3 to Datalake.
  • Designed and Developed framework to sftp files to different servers.
  • Designed and Developed framework to fix small files issue.
  • Responsible to manage data coming from different sources.
  • Designed and Developed performance optimizations for queries/operations on large datasets.
  • Provided technical assistance during impact assessments and implementation.

Environment: Hadoop, ETL, Hortonworks Data Platform 2.x, Spark, Spark Streaming, Linux, HDFS, Hive, Sqoop, Flume,Kafka, Zookeeper and HBase, Java, Hive, Oracle, Cloudera Manager, Spring, Hibernate, TOAD, Oraoop, RESTFull webservices, SQL, Core Java, Oracle, Toad, LINUX, UNIX, XMLP, SQL*Plus,Git, FTP, SVN, Windows, AWS,Amazon S3.

Confidential, Boston

Senior Developer/BigData Developer

Responsibilities:

  • Design/development of Authloader(redesigned), Auth Extractor, CareWebQI, Daily Feed Status Report, Health Monitor, and Daily Check List Reports.
  • Bug fixing and Maintenance activities for Case Manager 3.x.
  • Expertise in Performance improvement and root cause analysis.
  • Worked on Case Manager 3.x for performance improvement like Nurtur, Fallon and CCA batch jobs and improved performance of jobs up to customer satisfaction.
  • Trouble shooting TruCare/Case Manager 3.x issues.
  • Expertise in providing Workarounds for quick help on production issues.
  • Expert in writing SQLs for Case Manager 3.x and TruCare support issues.
  • Developed Soap Web services for Case Manager 3.x to improve performance.
  • Profiling apps for deadlocks, memory locks and performance issues using Your Kit Profiler.
  • Understanding customer requirements and converting it to technical documents for implementation.
  • Estimations and Code reviews for Case Manager 3.x
  • Involved in requirements gathering and designing, server side coding using Spring MVC, Spring and Hibernate.
  • Developed Batch jobs using Spring Batch framework.
  • Developed extracts for various client using PIG/Hive and Mapreduce.

Environment: Windows/Linux, Java, Java Script, Html5, CSS, jQuery/AngularJS, XML, Spring, Spring Batch, Hibernate, JBoss5/Glassfish, Maven, JUnit, Ant, SVN, Jasper/iReports,,SQLServer, Hortonworks 1.x, Hadoop, Mapreduce, Hive and Pig.

Confidential

Responsibilities:

  • Involved in requirements gathering and designing, server side coding using Spring and Hibernate, SQL queries, Actions, Filters, Handlers and JSP’s using HTML, CSS, JavaScript, and Ajax.
  • Developed several EJBs for research and panel deployments.
  • Develop Batch job oriented services with Threads, Code reviews and Axis2 Web Service (WSDL) extensively,
  • JUnit and TestNG test cases and profiling the application.
  • Delivered Mobile Project, Security, Panel deployment projects along with team and various enhancements.
  • Bug Fixing and enhancements.
  • Involve in mentoring junior Programmers on technology and domain knowledge transition.

Environment: Windows XP, Linux, Java, JDCB, JSP’s, Ajax, JQuery, HTML, CSS, XML, Spring, Hibernate, EJB, My Eclipse 5.5, Maven 2.0.7, JUnit, TestNG, SVN, SQLServer, UML, XHTML, WML, WAP, XSLT, JAXB, JAXP, Saxon and Log4J.

Confidential

Senior Software Engineer

Responsibilities:

  • Involved in requirements gathering.
  • Designed and developed SSO for Unilever and purchase order site.
  • Developed server side classes, JSP’s, Actions, Forms, HTML, JavaScript, and JMS API to interact MQ Server.
  • Involved in mentoring junior Programmers on technology and domain knowledge transition.
  • Interacted with clients to get status updates and demos.
  • Unit testing bug fixes and enhancements.
  • Developed different modules with Struts framework.
  • Bug fixing.
  • Worked on Unit, Integration, and System testing.

Environment: Windows XP, UNIX, CSS, HTML, XML, JSP, Java, Servlets, JSTL, JDBC, JMS, Struts 1.2, SQL Server, DB2, WebSphere, Java Mail, RAD 6, UML and JavaScript.

Confidential

Software Engineer

Responsibilities:

  • Worked on Order, Admin, and Batch Job modules extensively.
  • Developed Order module using struts framework.
  • Bug fixing and maintenance release.
  • Involved in development of the user interface pages mainly using HTML, CSS & JavaScript.
  • Writing necessary database objects like stored procedures, functions, and triggers.
  • Writing test cases and bug-fixing.
  • Developed Key Generation module on time.
  • Unit testing bug fixes and enhancements.

Environment: Windows 2000, JSP, Java, Servlets, Struts 1.2, SQL Server, Tomcat 5, XML, XSL, DTD, XSD, Eclipse 3.0, JUnit, CSS, HTML, and JavaScript.

We'd love your feedback!