We provide IT Staff Augmentation Services!

Senior It Consultant | Senior Hadoop - Spark Developer / Etl Developer Resume

2.00/5 (Submit Your Rating)

NY

SUMMARY:

  • Results - driven, customer-focused, and accomplished professional wif more TEMPthan 20+ years of proven expertise in all aspects of IT project management including 5+ years of Big data technologies. Known for integrity, exemplary work ethic and strong commitment to provide innovative and strategic solutions aligned wif diverse client needs and interests

TECHNICAL SKILLS:

Big Data/ Hadoop Technologies: Hadoop | HDFS | YARN | Map Reduce | Pig | Hive | HBase| Sqoop | Flume | Scala | Oozie | Spark | Spark SQL | RDDs | NoSQL | HiveQL | Kafka | Cassandra

Cloud Technologies: Amazon EC2 |Amazon ELB | Amazon Elastic BeanStalk | Amazon ECS | AWS Lambda | Amazon VPC | Amazon S3 | IAM | KMS | Cloud HSM | Amazon EBS | Amazon EFS | Amazon Storage Gateway | Amazon Databases (Amazon RDS | Amazon Aurora | Amazon DynamoDB | Amazon ElastiCache) | Amazon CloudTrail | Amazon CloudWatch | Amazon SQS | Amazon SNS | Amazon MQ | Amazon CloudFront | Route53 | Amazon RedShift | Amazon EMR | Amazon Glue | Amazon Kinesis |

Application Servers: Apache Tomcat (5.x/6.x) | Oracle Web Logic 10.1.3 | Oracle 10iAS/9iAS (Apache, OC4J, Portal SSO)

Database: Oracle (11g/10g/9i/8i/8.0) | SQL Server (2008/2005)

Software: OBIEE 11g/10g | Oracle BI Publisher | JDeveloper 11g | SQL Developer | TOAD | Oracle Developer Suite 11g/10g (FORMS 11g/10g, REPORTS 11g/10g) | VSS | TFS | Oracle Designer | SQL*PLUS | SQL*LOADER | Oracle Enterprise Manager | Eclipse | Pycharm | Jenkins | Git and Sprint

Programming Languages: SQL | PL/SQL | Pro*C | C | JAVA | COBOL | Clipper | HTML | CSS | JavaScript | ASP | XML | Oracle ADF Faces | XSLT | XSL | AJAX | Korn Shell | C Shell | Bourne Shell | Unix | Linux | Python | Java

Data Modeling Tools: Power Designer | Oracle Designer | Oracle BI Administration | Informatica

PROFESSIONAL EXPERIENCE:

Confidential - NY

Senior IT Consultant | Senior Hadoop - Spark Developer / ETL Developer

Tools: Hadoop 2.0, HDFS, YARN, Pig, Hive, Sqoop, Flume, Map Reduce, Linux, Oracle 11g, Toad, SQL Developer, SQL, PL/SQL, Netezza, Amazon AWS, Altryx, Unix Shell scripts, Spark-Streaming, Spark-SQL, Scala, Python, Kafka, Linux, Java

Responsibilities:

  • UsedHadoopscripts for HDFS (HadoopFile System) data loading and manipulation; Assisted in loading large sets of data to HDFS using Sqoop
  • Analyzed user request patterns and implemented various performance optimization measures includingimplementing partitions and buckets in HiveQL; Used Spark API over Cloudera Hadoop YARN to perform analytics on data in Hive
  • Used Pig for data cleaning and optimization and Developed and tested Hive queries for data analysis to meet the business requirements; Developed and executed custom HIVE queries, Created Hive tables, views and using in HiveQL
  • Developed Scala scripts, UDFs using both Data frames/SQL and RDD/MapReduce in Spark for Data Aggregation, queries and writing data back into OLTP system through Sqoop; Loaded the data into Spark RDD and do in memory data Computation to generate the Output response
  • Optimizing of existing algorithms in Hadoop using Spark Context, Spark-SQL, Data Frames and Pair RDD's
  • Created Oozie workflows to automate the data loading process
  • Exported data from HDFS to RDBMS (Oracle, Netezza and Amazon Redshift) via Sqoop for Business Intelligence (Micro Strategy and Tableau), visualization and user report
  • Updated document for Map Reduce jobs to generate reports for the number of activities created on each day, during adumped from the multiple sources and the output was written back to HDFS
  • Created and Scheduling ETL job for populating data for generating Matrix reports in Oracle, Netezza and Red shift
  • Developed new job for transferring data between Oracle, Netezza and Red shift and scheduling for daily execution
  • Created shell script to call and schedule ETL job and various reports and CSV files and transferred using secure FTP

Confidential - NY

Senior IT Consultant | Hadoop / ETL Developer

Tools: Hadoop, HDFS, Map Reduce, YARN, Hive, Pig, Sqoop, Oozie, Oracle PL/SQL-ETL, Informatica, SQL, Unix, Java

Responsibilities:

  • Importing and exporting data into HDFS and Hive using Sqoop
  • Used Pig for data cleaning and optimization and Developed and Tested Hive queries for data analysis to meet the business requirements
  • Analyzed user request patterns and implemented various performance optimization measures including implementing partitions and buckets in Hive; Developed and executed custom HIVE queries, Created Hive tables, views and using in HiveQL
  • Experienced in defining job flows and managing and reviewing Hadoop log files
  • Supported Map Reduce Programs those are running on the cluster
  • Involved in creating Hive tables, loading wif data and writing Hive queries which will run internally in map reduce way
  • Created Informatica source-to-target mapping using different transformations to implement business rules to fulfill the data integration requirements.
  • Converting data integration models and other design specifications to Informatica source code
  • Worked on SQL developer querying the source/target tables to validate the SQL and Lookup override
  • Worked extensively on performance improvement and query tuning tasks in Oracle

Confidential

Senior IT Consultant | Senior Oracle Developer

Tools: Oracle 10g, Power Designer, SQL, PL/SQL, SQL Server, SQL Developer, Oracle BI Publisher, Power Designer, TOAD, Oracle Developer Suite 10g(Forms, Reports), Oracle Designer, Oracle 10iAs, Asp.Net, C#.Net, Java

Responsibilities:

  • Involved complete project cycle from Requirement Analysis to Implementation and successfully deployed Online Parking System(OPRA), Integrated Contracting and Procurement Systems (ICAPS), Workforce Information Management, Capital Project Management, Vendor Registry for Architectural and Engineering Services (VRAES) projects at Confidential
  • Created and provided support on database schemas, business rules, functional requirements, and code scripts using Oracle 10g, SQL, PL/SQL, Program Unit
  • Utilized Power designer to create and manage physical data and E-R models
  • Created and provided support on database schemas, business rules, functional requirements, and code scripts using Oracle 10g, SQL, PL/SQL and Program Unit (functions, procedures, packages, database triggers, sequences, synonyms and grants)
  • Took charge of tuning performance of database objects, including tables and store procedures
  • Designed, developed and maintained interface between data movement between various systems
  • Built and ran unit testing scripts prior to code deployment, and sent results to the rational quality manager (RQM) system
  • Utilized Oracle BI Publisher Desktop to develop reports through templates made in Microsoft Word; integrated reports wif application and devote efforts to produce output in PDF, Excel and CSV formats
  • Applied Oracle encryption and decryption to validate interface users, and utilized AES256 algorithm to invoke interface processes
  • Used VSS and TFS to maintain versions of code for various systems
  • Drafted system design, interface design and developer guide documents; managed them in SharePoint
  • Built, compiled and managed patches to resolve system issues and provide system enhancements; collaborated wif quality assurance units and end users to release patches across multiple platforms
  • Excellence for Successful implementation of the BLIMS Project Module Phase I Project, 2009
  • Gained the Premier’s Teamwork for the successful implementation of the Capital project module, 2010
  • Achieved the Premier’s for BLIMS Project Module Testing & Implementation, 2011

Confidential

Senior IT Consultant | Senior Oracle Developer

Tools: Oracle 10g, SQL, PL/SQL, SQL Server, SQL Developer, TOAD, Oracle Developer Suite 10g(Forms, Reports), Oracle 10iAs

Responsibilities:

  • Working as Sr. Consultant at client Christian Children's Fund of Canada(CCFC), Labourers' Pension Fund, George Brown Colege, Ministries of, Colleagues and Universities
  • Designed, evaluated, supported, managed and tested document database and application automation for mail merge and automated batch processes in generating daily, weekly and monthly reports
  • Leveraged technical expertise in swiftly resolving bugs and errors in the SMART system
  • Performed unit testing and documentation, and provided support in project implementations
  • Performed system analysis and design to determine federal and provincial tax through a tax formula provided by the government
  • Constructed new batch programs and Oracle forms and reports in accordance wif project guidelines
  • Utilized PL/SQL HTML Package to create new web page for the registration site; Managed component versions using VSS version control system
  • Assumed responsibility in the development of database, as well as the database procedural logic for the meta-data driven financial reporting system
  • Functioned as main technical support for the application and database system, including troubleshooting, system enhancement, and problem resolution

Confidential

Senior Oracle Developer | Senior Oracle Database Administrator

Tools: Oracle Database 8i/9i, SQL, PL/SQL, Toad, Oracle Developer Suite 9i (Forms, Reports), Oracle Designer, Oracle 9iAS, Developer 2000 (Forms 4.5, Reports 2.5), Solaris 2.6/2.5.1, C, Pro*C, UNIX, SQL Server 2000/2005, Java, JDBC

Responsibilities:

  • Played a major role as part of a team to receive the International CIO 100 for Resourcefulness in recognition for the successful implementation of an ERP system for supply chain management

We'd love your feedback!