We provide IT Staff Augmentation Services!

Big Data Developer Resume

2.00/5 (Submit Your Rating)

Frisco, TexaS

PROFESSIONAL SUMMARY:

  • Around 2 years of Experience in IT industry in providing solutions for Big Data using Hadoop 2.x, HDFS, AWS, MR2, YARN, Spark, Kafka, PIG, Hive, SQOOP, Flume, HBase, Cloudera Manager (CDH4,CDH5), Horton Works Distributions (HDP), Zoo keeper, Oozie and Hue
  • Excellent understanding/ knowledge of Hadoop architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node, Resource Manager and Map Reduce.
  • Hands on experience in Python, core JAVA, SQL Queries and Linux shell scripting.
  • Experience on working with Content Management Systems like Wordpress and Drupal along with CSS Backgrounds, CSS Layouts, CSS Positioning, CSS Animations, CSS Text, CSS Borders, CSS Margin, CSS Padding, CSS Table, Pseudo Classes and Pseudo Elements.

TECHNICAL SKILLS:

Script Languages:: Shell Scripting, Python, Unix script

Big Data Technologies: HDFS, EMRFS, MapReduce, HBase, Hive, Hue, Pig, Sqoop, Flume, Spark, Zookeeper, Oozie, Kafka

DataBase: MySQL, Oracle, Teradata, MSSQL, SQL Server, DB2, SQLLite, Hbase, MongoDB.

Programming language: Python(Advanced), Java(Advanced), R(Intermediate), C(Intermediate), Shell Scripting(Advanced), Php(Intermediate), MATLAB(Advanced), Javascript (Intermediate)

IDE s: Codeblock, Pycharm, Eclipse, Netbeans, Pydev

Virtual Machines: VMWare, Virtual Box

OS: Cent OS 5.5, Red Hat, Ubuntu, Fedora, Debian, Windows, Kali

Web Servers: Apache Web Server, Apache Tomcat 5.x/4.x, WAMP, LAMP, XAMPP, Acquia Dev Desktop.

Web Hosting: FTP, Filezilla, Cpanel, DNS

Methodologies: Agile - Scrum, Waterfall, TDD

Electronic Simulation Softwares: Topspice, Pspice, LTspice, Simulink Content Management Systems(CMS): Drupal, Wordpress, Joomla

Machine Learning Tools: OpenCV, Theano, TensorFlow, Pygame, OpenGL, Numpy, Sympy, Scipy, Pandas

Web Technologies: Django, HTML/5, CSS/3, XHTML, Java Script, React Js, XML, SOAP, REST, Bootstrap, JSON, AJA

PROFESSIONAL EXPERIENCE:

Big Data Developer

Confidential, Frisco, Texas

Environment: Hive, Flume, Sqoop, Spark SQL, Kafka, Yarn, MySQL, Map Reduce, Oracle, Oozie, Hue, HDFS, EMRFS, AWS, Elastic Map Reduce, Cloudera, Python, Java, Shell Scripting, Teradata, GitHub, LINUX, Scrum

Responsibilities:

  • Worked on Spark SQL, Spark Streaming, Reading/Writing data from JSON file, text file, parquet file, Schema RDD.Implementation of Big data batch processes using Hadoop, Map Reduce2, YARN, PIG, Hive and Spark..
  • Used Oozie workflow engine for managing interdependent Hadoop jobs and to automate several types of Hadoop jobs.
  • Developed Sqoop scripts to import and export data from RDBMS and handled i Confidential emental loading on the customer and transaction information data dynamically.
  • Written Python applications to interact with the MySQL database using spark SQLContext and also accessed Hive tables using HiveContext.
  • Extensively worked on partitioning Hive Tables and running the hive scripts in parallel to reduce run time of the scripts.
  • Good experience in importing other enterprise data from different data sources into HDFS using Sqoop, Flume and kafka, involved performing transformations using Hive and then loading into HBase tables with various compressions.
  • Involved in data transformations, developing simple to complex Map/Reduce jobs using Hive and Pig to handle files in multiple formats (JSON, Text, XML, Avro, Sequence File and etc.)
  • Expertise in analyzing the data using HIVE and writing custom UDF's in python for extended HIVE and PIG core functionality.
  • Responsible for the Implementation of POC to migrate map reduce jobs into Spark RDD transformations using Python.
  • Worked on partitioning Hive Tables and running the hive scripts in parallel to reduce run time of the scripts.
  • Experience on flume to collect log data from various sources and transfer data type into hive tables using different SerDe’s to store Json, Parquet, xml, and Avro file formats.
  • Responsible to manage data coming from different sources, also perform various data transformations like filtering data, joining tables and aggregations.

Teaching Assistant

Confidential, Edwardsville

Responsibilities:

  • Helping students with the coursework and labs

Technologies: Simulink, Topspice, LTspice, Pspice

Teaching & Research Assistant

Confidential, Edwardsville

Responsibilities:

  • Worked on k-means neighbourhood. Research on diseased dogs using thermographic images on symmetric based analysis.
  • Helped in software development, developing some image processing methods in Matlab.

Technologies: Matlab, Python, Visual studio, C

Graduate Assistant

Confidential, Edwardsville

Responsibilities:

  • Assisting Dr. Ramana with documentation, photshop, preparing data in Excel sheets.
  • Organizing the department events and seminars.

Student Intern

Confidential

Responsibilities:

  • Worked on case study of different available sources of power at a particular location and improving the standby capacity of UPS.
  • Worked on the firing values of the SCRs, FET’s(MOSFET and JFET) and different diodes.
  • As a student intern, it gave me an insight into the power grid system and its maintenance of data acquisition and manipulation in real-time.
  • Electric Circuits: Tektronix oscilloscope, function generator, circuit board
  • Troubleshooting: Color code resistors, capacitors, diodes, & transformers.
  • Worked with ARM models and PIC micro-controllers.
  • Statistical analysis of different power resources available at a particular site using Statistical R programming language.
  • Worked on Pic C compiler to embed the code to the PIC micro-controller.
  • Worked on A/D and D/A circuits using the AVR timers.
  • Worked on Frequency Modulation, RF technology to intercommunicate between the power sources.

Drupal/Wordpress Developer

Confidential

Responsibilities:

  • Database maintenance, backups and modifications
  • Created Help Desk for user's queries to meet the bulk queries submitted by the users.
  • Creation of new pages, Database and Server Administration, In corporation of a secondary site for use as a development/test site
  • Maintained groups of multiple users with Drupal, Wordpress CMS.
  • Used DRUSH for Drupal website updates.
  • Created web pages using Html, CSS, WordPress.
  • Developed custom themes using Drupal themes.
  • Developed Drupal custom module for ingestion using PHP, Drupal and XML.
  • Developed user interface using HTML, CSS, AJAX, jQuery and JavaScript..
  • Implemented and upgraded various Drupal modules.
  • Worked in Agile based environment with daily scrum calls and coordination with the offshore team.
  • Experience on working with CSS Backgrounds, CSS Layouts, CSS Positioning, CSS Animations, CSS Text, CSS Borders, CSS Margin, CSS Padding, CSS Table, Pseudo Classes and Pseudo Elements.
  • Good understanding of Model View Controller(MVC) P Confidential ern.

Image Analyst/Machine Learning

Confidential

Responsibilities:

  • Integrate natural language processing approaches for music named-entity extraction.
  • Compared the supervised and unsupervised models performance based on datasets that different from sample size, feature dimensions, and continuous or discrete. Models include KNN, Adaboost decision trees, SVM, Neural Networks; K-means, Reinforcement, etc
  • Working on Tensorflow with docker connection and jupyter to create a auto-grammar check on English language sentences with the help of neural networks.
  • Working on mood predictor depending on different circumstances using Theano/python.
  • Experimenting on different cryptography techniques to get a better security, more reliable and minimum time for processing.
  • Image Compression Using Neuro analysis: Trying to develop an algorithm for lossless image compression with an equation analyzer with the current techniques available in deep learning / mathematical algorithm which can yield up to a compression ratio greater than 30.

We'd love your feedback!