Sr Core Java Etl Developer Resume
Woonsocket, RI
SUMMARY
- 15+ years of experience in the Computer Industry as a Programmer/Analyst with several complete project life cycles.
- Experienced with Systems Analysis, Design, and Development, Testing, Implementation.
- Experienced with Production Support and interaction with the Business/Requirement Analysts.
- 12+ years of experience in Oracle Pl/SQL, SQL, HiveQL, NZSQL,SparkSQL,Postgres
- 7+ years of experience in Core Java and 3+ years in J2EE (Servlet, JSP, DAO Layer) JDBC, Design Patterns, object oriented methodologies.
- 5+ years of experience in scripting language like Unix Ksh, Perl
- 3 years in using MPP appliances like Netezza/Greenplum, Teradata and handling big data with Hive/Hadoop/Presto and Spark using Java/Python.
- 2+ year of scripting,data analysis and validation with Python
- Extensively involved in Performance tuning complex SQL and packages.
- Deep understanding of ETL process involving Hadoop echo system.
- Spark analytics for pattern recognition and firm co - relation detection.
- Hands on Oracle XML DB and XQuery.
- Experienced in Postgres,T-SQL in Sybase12.5,SQL Server 2000 DTS.
- Familiar with Logical and physical modeling of DB objects.
- Experienced in Oracle Forms 5.0/6i/9i/10g and Oracle Report 3/6/6i/9i/10g, Business Objects.
TECHNICAL SKILLS
Operating Systems: Win2000, XP / NT, Linux, Unix
Databases: ORACLE 11g/10g /9i, Postgress,Sybase Adaptive Server 12.5 / MS Access 2002/2000, SQL Server 2000
MPP/Big data: Netezza, Greenplum, Hive, Hadoop, Presto, Spark, Teradata
Other packages: MS office
Data Modeling: Erwin, Designer 2000
Configuration Management Tool: Visual Source Safe, PVCS, SVN, SCM
Programming Languages: PL/SQL,SQL, Java, C
Scripting: UNIX Shell, Perl, Python
GUI: Oracle Forms 6i, 9i, Oracle Reports 6i, 9i, Visual Basic 6.0/5.0,BO 6.5, VBA
IDE: Eclipse 3.3.1.1, Altova XML Spy2010 Pro
Reporting: Business Objects, Oracle Reports, MS Excel, Unix awk, sed
PROFESSIONAL EXPERIENCE
Confidential, Woonsocket, RI
Sr Core Java ETL Developer
Responsibilities:
- Developing lookup service using Core Java and SQL.
- Used GSON to convert JSON to object and vice-versa.
- Used JDBC for database connectivity and SQL.
- Used Log4J to capture the log.
- Reused the extended framework to generalize the service.
- Teradata SQL to look up huge amount of data.
- Used Teradata utilities like MultiLoad, Tpump, and Fast Load to load data into Teradata data warehouse from Oracle.
- Created BTEQ scripts to extract data from warehouse for downstream applications.
- Create Ad Hoc and Tactical BTEQ queries, Macros and Stored Procedures as ETL Interfaces and Shell scripting for batch processing and utilities.
- Developing approach, test and deployment documents for the service.
Environment: UNIX Bash/Ksh, Perl 5.8, Java 1.7,Eclipse, Oracle, Teradata 15.0
Confidential, Manassas, VA
Big Data Developer
Responsibilities:
- Importing and exporting data into HDFS and Hive using Sqoop.
- Involved in performance tuning of Hive from design, storage and query perspectives.
- Created Partitioned and Bucketed Hive tables along with different compression technique.
- Developed Spark core and Spark SQL scripts for faster data processing.
- Worked with different source data file formats like JSON, CSV, TSV etc.
- Used Pig as ETL tool to do transformations, event joins and some pre-aggregations before storing the data onto HDFS.
- Implemented Spark RDD Transformations and Actions.
- Used spark analytics for pattern recognition and potential threat identification in payment gateway.
- Code Review and unit testing.
- Writing unit/integration test plan.
Environment:, UNIX Bash/Ksh, Perl 5.8, Jira,Clearcase, Java 1.8,Eclipse, Apache Hadoop, AWS, EMR, EC2, S3, MapReduce, Hive, Pig, Sqoop, Apache Spark, Oracle
Confidential, Rockville, MD
Big Data Developer
Responsibilities:
- Create complex SQLs to analyze and validate Confidential /SEC rules using different databases (Oracle) and appliances (Netezza, Greenplum etc).
- Consuming REST web services using Java.
- Developed MapReduce programs for pre-processing and cleansing the data in HDFS obtained from heterogeneous data sources to make it suitable for ingestion into Hive schema.
- Extensively worked on creating combiners, Partitioning, distributed cache to improve the performance of Map Reduce jobs.
- Used Pig to perform data transformations, event joins, filter and some pre-aggregations before storing the data onto HDFS.
- Data analysis using NZSQL and HiveQL/Presto and Linux shell.
- Validate output table and AWS S3 table structure and data using Python SQLite.
- Java utility to create table DDL/Insert/Select structure from JSON.
- Writing UDF in Hive/Spark.
- Parsing XML using Java and Validate Oracle table DDL.
- Involved in creating Hive tables, loading structured data and writing hive queries.
- Set based processing with different create table strategy in Hive/Netezza.
- Storing output data in AWS S3 for future use and sourcing from there.
- Used Spark analytics and graphs for potential firm collusion and correlation.
- PostgreSQL for operational use and metadata maintenance.
- Design, development, unit testing, documentation of the assigned work products.
Environment: ORACLE 11g, SQL Developer, Eclipse, UNIX Bash/Ksh(Sunsolaris), Perl 5.8, Jira, Jenkins, Python, Hive, Netezza, Greenplum, Apache Hadoop, Spark, Hive, Pig, Sqoop
Confidential, Suitland, MD
Java SQL Developer
Responsibilities:
- Created customized ETL process using PL/SQL, Java, Unix KSH and Perl script.
- Created Core Java based utilities to read and shred XMLs to Oracle table.
- Created java utility and helper classes for common purpose.
- Used java logger API for development and run time debugging of the application.
- Implemented DAO for data access with Object-Relational mapping using iBatis.
- Used Ehcache for caching.
- Developed test cases and done unit testing with Junit.
- Build using Ant.
- Multithreaded to facilitate downloading of files in parallel.
- Used design patterns and industry best practices such as MVC (Model-View-Controller), Singleton, Facade, Factory and DAO, DTO.
- Used Oracle XML DB functionality to extract data from Oracle 11g.
- Performance tuning complex SQL and packages
- Used SQLLDR, Oracle 11g Datapump to transfer/load data
- Troubleshooting issues found in JBOSS application server logs.
- Code/Technical Design Review, creating quick prototype for proof of concept.
Environment: ORACLE 11g, PL/SQL Developer, TOAD, Eclipse, Altova XML Spy, Windows NT, UNIX KSH93(AIX), Perl 5.10, Test Director, PVCS
Confidential, Rockville, MD
Sr Developer
Responsibilities:
- Performance tuning Packages and procedures in Oracle 10g
- Tuning complex SQL in VLDB
- Used partitioned table and indexes and parallel SQL/DML
- Design data extract process from different schema
- Creating staging table and index
- Used Perl regular expression to clean the incoming files
- Used Perl dbi module to run database Packages, Procedures and SQL.
- Used Pragmas to standardize the Perl code
- Unix Shell script to run report and mail/ftp output
- Unix AWK, SED utility to generate ad hoc reports on flat files
- Unit testing and writing technical specification document.
Environment: ORACLE 9i, PL/SQL, TOAD, Windows NT, UNIX, Perl 5.8, Test Director, SCM
Confidential, Stamford, CT
Sr Programmer Analyst
Responsibilities:
- Logical and physical modeling of Star schema using Erwin
- Reverse engineering and enhancing existing data model for data mart.
- Created T-SQL stored procedure in adaptive server 12.5
- Used BCP utility to migrate data from different Sybase database
- Business Object 6.5 universe and report creation and maintenance
- Created web intelligence drill down reports in BO Infoview 6.5
- Built JSP pages to invoke BO Web Intelligence Reports
- Modified and forward engineering data model in ERWIN
- Data migration from staging to target tables in Oracle 9i
- Used analytical function for data migration
- Involved in Oracle SQL tuning using optimizer hints, creating index, restructuring queries
- Created Perl script for batch jobs.
- Used Perl DBI module to work with databases
- Unix shell script to create environment variables and load data
- Maintained access/VBA code
Environment: Business Object 6.5,ORACLE 9i, PL/SQL, TOAD, DB Artisan 812,PL/SQL Developer, Windows 2000, Unix, Test Director 7.6, Clear Case, SVN, Erwin, Sybase Adaptive Server 12.5,Rational ClearQuest .MS Access2003,VBA
Confidential, Marlborough, MA
Sr Developer
Responsibilities:
- Archived and migrated old data to archiving tables using oracle pl/sql
- Used PL/SQL analytical functions, table functions and pipelined functions to write complex SQL
- Oracle SQL Tuning using explain plan and TKPROF utility.
- Test Director defect resolution
Environment: ORACLE 9i, PL/SQL, PL/SQL Developer, Windows 2000, UNIXTest Director 7.6, Acurev
Confidential, Bethlehem PA
Developer
Responsibilities:
- Created design documents for new forms
- Enhanced Oracle forms and reports in Forms 6i and Reports 6i
- Created prototype in Forms10g with the existing forms and added new 9i features
- Created JSP pages to interact with Oracle Forms/Reports
- Creating PL/SQL Libraries in forms 6i
- Created PL/SQL stored procedure, trigger, and global temp table
- Tuned Oracle procedure and packages
- Used optimizer hints and restructured SQL for better performance
Environment: ORACLE 10g,Forms10g,Reports10g, PL/SQL, TOAD, Windows NT, Unix, Test Director 7.6, PVCS, Erwin.
Confidential, Summit, NJ
Senior Developer
Responsibilities:
- Deployed Oracle9i forms and reports in 9iAS.
- Developed Packages, which construct Ref Cursors and developed Forms and Reports based on Ref Cursor.
- Build forms using Forms6i and 10g
- Build Reports utilizing Oracle Reports Builder 6i and 10g
- Used webutil to generate file in local client desktop
- Used Java stored procedure and call from Oracle Forms
- Used PL/SQL Object Types, Bulk Collect, Dynamic SQLs, DBMS JOBs, DBMS UTL, and Analytical Functions for PL/SQL Programming.
- Created and maintained DB-Links, Synonyms, Sequences, Materialized Views, Global Temporary tables.
- Optimizes the SQLs for optimum performance by using SQL Trace, TKPROF and EXPLAIN PLAN.
Environment: ORACLE 8i/10g, PL/SQL, TOAD, and Oracle Forms 6i/Reports 10g, Oracle 10g Streams, Windows NT, UNIX, Test Director 7.6, PVCS, Erwin.
Confidential, Waukesha, WI
Developer
Responsibilities:
- Extensively involved in Analysis, Design, Development and Testing.
- Modeling and Logical/Physical design of database schema using Erwin
- Developed Database Triggers, PL/SQL packages, Procedures and Functions for coding the business rules.
- Used Oracle UTL file features to create flat files and Procedures for Data Extraction.
- Developed several UNIX scripts for batch processing via Unix Cron.
- Developed SQL*loader scripts to load the data from flat files to the Oracle Tables using direct path methods.
- Performed SQL tuning using Oracle's Explain Plan and TKPROF utilities.
- Created several Oracle Forms and Reports and web enabled them
- Created PL/SQL libraries, object libraries for forms
- Developed Blue Book tool using Java, JSP,Servlet, HTML,CSS,Java Script in Weblogic 8.1
- Used MVC model
- Used DAO layer to call stored procedure in Oracle
- Sybase t-sql stored proc and trigger.
- Created stand alone Java testers to parse XML documents.
Environment: ORACLE 8.x/9i (9.2.0.4), PL/SQL, Sybase, Sun Solaris 8, Weblogic 8.1, Mercury Test Director 7.6, Wincvs, Sybase adaptive server 11,XML
Confidential
Developer
Responsibilities:
- Conversions of Legacy Systems to Oracle Based Systems.
- Developed and maintained the conversion process to convert different legacy systems to Oracle based system through extensive customer contact and analysis of customer data.
- Written complex SQL queries, PL/SQL programs, procedures, functions, database triggers, packages, Temporary Tables and SQL* Loader programs for conversion.
- Created different reports using oracle report builder 6i and SQL scripts to verify the source and converted information.
- Used export, import utility
- Developed numerous programs using PL/SQL and many packages to do the validations as per requirements.
Environment: UNIX, ORACLE 8.x, Oracle Forms/ Reports/ Designer 6.0, WINDOWS NT/2000, PL/SQL, SQL *Loader, SQL *Navigator, TOAD, SQL *Plus
Confidential
Programmer
Responsibilities:
- Creating PL/SQL Procedures, triggers
- Designing tables, DFD, ERD
- Creating Forms, Reports, shell scripts
- Creating PL/SQL libraries, object libraries in form
- Import/Export schema.
- Loading using SQLLDR.
- Query tuning using EXPLAIN PLAN, TKPROF, and PERFSTAT.
- Migrating forms 5 to 6.0.
- Workflow system using Lotus Notes5.0
- Used SQL Server T-SQL for procedure and package
- Used SQL Server DTS for data transfer
Environment: Oracle 8.0.5.2.0, Designer 2000(R 2.1.2) & Developer 2000 (Forms 5.0, Reports 3.0), SQL Server 2000 DTS,T-SQL, Lotus Notes5.0, TOAD (Tool for Oracle Application Developer), SQL, PL/SQL, Windows NT,
