Big Data Engineer Resume AZ - Hire IT People

SUMMARY:

About 10 years of experience as Software Engineer, working in different phase of software lifecycle
Major area of technologies covers big data domain like Hadoop/HDFS, Pig, Hive, Spark, Sqoop, Oozie, Map Reduce
Programming language used are Java, Scala & Python
Take ownership of project and make sure it get delivered in a very semantic way
Excellent written and verbal communications

TECHNICAL SKILLS:

Big Data Technologies: Hadoop, HDFS, Hive, Map Reduce, Sqoop, Pig, Spark

Languages: Java, Scala, Python

Scheduler: Oozie, Cron

Storage & Search: Elastic Search

No SQL Database: Cassandra

Databases: Oracle, MySQL, MSSQL

Servers: Apache Tomcat

Operating Systems: Windows, Linux

PROFESSIONAL EXPERIENCE:

Confidential, AZ

Big Data Engineer

Responsibilities:

To identify the possible fraud claims for the HOME policies
I have developed Confidential project using apache Spark
I have architected and developed the different layers, so that the needed data are brought from source into the hadoop environment, then filtered / processed, and finally ingested in elasticsearch
Created data pipeline using Sqoop to extract the data from different sources systems
Developed Spark application to identify the fraud claims
Stored the processed data into ElasticSearch using Spark
Scheduled Sqoop & Spark jobs through Oozie

Confidential, AZ

Big Data Engineer

Responsibilities:

To identify the possible fraud claims for the AUTO policies
I have developed Confidential project using apache hive
I have architected and developed the different layers, so that the needed data are brought from source into the hadoop environment, then filtered / processed, and finally ingested in ElasticSearch
Performed data acquisition from Oracle to HDFS using Sqoop
Developed Hive jobs to combine incremental claims with the policy information
Ingested the records to ElasticSearch using Hive
Scheduled Hive and data extract jobs through Oozie and Cron

Confidential, AZ

Big Data Engineer

Responsibilities:

To provide fast, efficient, high availability search features to the agents and there by improve the business
I have developed the Confidential project using apache Pig
I have architected and developed the different layers, so that the needed data are brought from source into the hadoop environment, then filtered / processed, and finally ingested in ElasticSearch
Sqooped the data from different source systems using apache sqoop.
Created Pig Jobs to filter out the unwanted data
Created the Pig Jobs to combine the policy data with agent - agency information
Scheduled Pig jobs & Sqoop jobs through Oozie
Developed java programs to process the messages in queue
Created ElasticSearch indices as lookup indices to be consumed by the Hadoop jobs
Create multiple utility programs to be able to process the historic data on need by basis

Confidential, GA

Java Developer

Tools: used: java 1.7, eclipse, tomcat, IBM MQ

Responsibilities:

Created Java programs to process the messages in MQ
Developed UI screens to display the customer related information
Evaluated business requirements and prepared detailed specifications that follow project guidelines required to develop written programs.
Analyzed data sets to determine optimal way to aggregate and report on it.
Processed huge volume of data by effectively using the appropriate java data structures
Scheduled programs using cron jobs and made sure the jobs are processed everyday

Confidential, Sallie Mae, VA

Mainframe Developer

Tools: used: mainframe, cobol, jcl, VSAM, DB2, CICS

Responsibilities:

Created COBOL, JCL for executing the batch programs. Used tools to create JCL. Have good experience with DB2 database.
Proficient in SQL queries to retrieve the data from DB2 database
Created multiple online screens using CICS.
Created Business Spec documents, Technical Spec documents and Development Test plan
Used versioning tools like SVN to effectively maintain versions of the code
Worked on endevor tools to effectively carry out the deployment activities by staging the code at different staging environments.