Dba / Big Data Developer Resume
Hicksville, NY
PRODUCT EXPERIENCE:
Operating Systems: Linux, AIX, Sun Solaris, Microsoft products, HP - UX 11, PowerShell
Hands-on expert in: Perl, Python, Spark, PL/SQL, SQL (Oracle, Microsoft, PostgreSQL, DB2 flavors), VBA/VB, Shell scripting both Unix and DOS, VBScript, UML, JavaScript, Java, Pro*C, XML, C/C++, Lingo, Prolog, Veriwell Hardware Simulator
Databases: Oracle, Netezza, MySQL, SQL Server(6.2-2008), Progress 9.1D, DB2
Applications Servers: Oracle 10g Application Server OEM, Oracle 11g RAC
Analytics & Reporting: OBIEE, Oracle Warehouse Builder, Informatica Power center, Microstrategy, Oracle Discoverer, Talend, Pentaho, Business Objects 4.0, Cognos
Tools: ERStudio, ERwin, Toad Products, Aginity, DBArtisan, SQL*Navigator, Oracle RMAN, SQL*Loader, MS IIS, Apache, Visual Studio Application Suit, JDeveloper
PROFESSIONAL EXPERIENCE:
Confidential, Hicksville, NY
DBA / Big Data developer
Hands-on: Netezza, Hadoop, MySQL, Oracle PL/SQL, Perl, Python, Spark, Hive, Sqoop, Pig.
Responsibilities:
- Modern data architecture for high speed, high volume, near-real time data processing integrating backend Netezza, Hadoop, MySQL, and MongoDB platforms.
- Designed and administered zero-downtime mission-critical real-time backend data platform.
- Build data ingestion mechanisms and ETL processing: scripting, Talend, NZPLSQL, FluidQuery.
- Introduced best practices that changed development culture and elevated to a different level.
- Migrated from the paid-for solutions for alternative open-source solutions saving big $ on licensing costs and support.
- Cranked up and improved existing operations using existing resources: extensive use of 10 Gbit network, high-availability build, data replication techniques, data compression, automation.
Confidential
Big Data developer
Responsibilities:
- Design and build human-free automation for Netezza platform maintenance.
- SQL performance tuning and automation of existing ETL processes.
- Integrated Modern Data Lake data architecture running Cludera Hadoop Cluster.
- Performance tuning of data ingestion between Netezza and Hadoop Data Lake.
- Go-to SME for backed tuning and process automation.
Hand-on: Netezza, Claudera, Hadoop, Spark, Hive, Bash, Perl, NZPLSQL, Fluid Query, Pig
Confidential
Netezza DBA / Oracle Developer
Technologies: SQL, PL/SQL, Oracle, Bash scripting, automation VBA, Cognos, Business Objects.
Responsibilities:
- At kick off achieved 50% run time performance gain suggesting Oracle optimal configuration for data warehouse settings and illustrating the benefits with empirical POC.
- Wrote template framework PL/SQL packages that standardized work of a dozen of Oracle Developers consolidating the output a standard maintainable code base.
- Coached best practices and optimal design for Oracle data warehouse and ETL applications.
- Automated regression QA process that weekly saved QA group hundreds of men hours to run SQL manually using conventional tools.
- Facing system customers distilling complex business requirements into actionable project steps and, as a result, working SQL/ETL/Reporting code.
- SME in Oracle SQL and PL/SQL performance tuning
- Application integration SME optimizing and tuning for Cognos dashboards and DataStage.
Confidential, NYC
Netezza DBA/Developer
Technologies: SQL, Netezza, Oracle, PL/SQL, Perl, Bash, Python, Cognos, DataStage, Business Obj.
Responsibilities:
- Delivered Netezza end-to-end administration and automated unattended DB maintenance.
- One-stop-shop problem solver and go-to mentor for SQL developers, Cognos Framework developers and DataStage ETL developers.
- SME in system integration of Cognos/Business Objects, ETL and Oracle sources into coherent environment with central relational Data Warehouse center piece.
- Migrated and refactored complex legacy SQL onto new platform.
- Wrote elaborate and sophisticated shell script to achieve parallelism and automation.
- Participated in QA work automating regression testing (VBA) and saving hundreds of men-hours running and validating results.
- Expert hands-on developer of complex shell scripting, automated data integrity and data quality testing via SQL and PLSQL.
- Performance tuning, optimization. Solving complex movement problems of large data sets.
- Specializing in process optimization and task automation. Netezza best practices expert.
- Main subject matter expert for Netezza appliance.
Confidential
Netezza Data Architect / Netezza Admin/Developer
Responsibilities:
- Confidential for enterprise wide Database Platform Upgrade project from for Mainframe to Netezza.
- Netezza configuration, set up, migration, development, hard-core tuning.
- Intergrade and tune DataStage ETL processes. Database design tuning.
- Expert technical advisor on implementation and troubleshooting issues.
- Performance optimization. Automatic programming: programs writing programs.
- Integration of IBM Financial Standard Data Model at Netezza with DataStage ETL.
Confidential
Lead Data Architect
Responsibilities:
- Design and develop Confidential data warehouse system Oracle 11g RAC & Netezza.
- Managing expectations and deliverables closely working with senior management and business users.
- Implement business process automation, design and implement ETL processes
- Designed and implemented automated data quality test processes, with early notification controls.
- Senior expert in database tuning, code tuning, code refectory, model redesign.
- Design data mining procedures, implement prediction models, and advanced statistical calculations.
Confidential
System Developer
Responsibilities:
- Designed and developed Confidential with Oracle-based processing engine.
- Implemented automated predictive analytics engine in PL/SQL and Oracle data miner.
- Designed and implemented asynchronous Oracle - based file parsing, archiving and storage system to facilitate online user experience.
- Implemented complex user transaction management system for number of administrative users utilizing virtual private database (VPN) and row-level security (RLS) functionality.
Confidential
Data Manager (consultant)
- Managing data processes in highly transactional database environment. Integrated dispersed data sources.
- Designed and implemented process flow procedures to ensure uninterrupted and consistent data to service a group of 30+ QA annalists and 40+ Java developers.
- Provided senior expertise in database performance tuning and ETL process implementation.
Confidential, New York
Lead Data Architect
Responsibilities:
- Developing strategic vision for the department future, bringing in new professional culture.
- Lead and managed a team of four developers in ground-up end-to-end design and implementation of the enterprise data warehouse along with unified reporting system and standard presentation layer.
- Managing and participating hands-on in several migration projects getting away from legacy mainframe DB2 systems to the Oracle-based platform. Automating the migration of the old reports and processes to Oracle 10g Discoverer and third party reporting tools.
- Designed and implement the processes that integrate the disjointed multi-platform data into one unified Oracle-centric platform. Migrating to Oracle Warehouse Builder ETL.
Confidential, NYC
Oracle and SQL Server DBA / Data Architect
Responsibilities:
- Lead ground up design and implementation of production data warehouse with end-to-end business process automation and developing and integration a report-on-demand web based system.
- Administering, automating, and tuning database performance, backup, space management, disaster recovery of over the terabyte system. Working with developers tuning application code and SQL.
- Designing and implementing end-to-end ETL process. Heavy programming in PL/SQL, Perl, Java, DOS/shell scripts and Oracle utilities. Complete Linux/Windows OS administration.
- Implementing jobs in Informatica Power Center for ETL data loads from external data sources. Integrating third party databases using the aforementioned tool..
- Implementing highly complex automated reports in various formats: web publishing, spreadsheets, pdf, text, email attached, graph data. Heavy data massaging, parsing, formatting, archiving in Perl.
- Establishing and implementing data cleansing strategies. Designing and imposing system metrics. Justifying business rules and implementing fuzzy logic processing.
- Implemented automated online report-on-demand system enabling users with real time data mining capabilities. (CGI, JavaScript)
- Supporting and writing the online system documentation. Facilitating the documented system errors, ideas exchange, and tip lookup between company developers via centralized BI forum.
Confidential
DBA/Oracle Developer
Responsibilities:
- Performed database re-organizations as required assisting performance and ensuring maximum uptime of the databases.
- Created and maintained repository of ER-Diagrams for production and development systems utilizing Embarcadero ERStudio.
- Ultimately responsible for user enrollment. Implemented and enforced security for all of the Oracle Databases.
- Developed triggers, procedures and packages. Conducted code analysis and tuning for best performance (SQL, PL/SQL).
- Performed data transfer using SQL*Loader, Export and Import utilities. Assisted developers with integration of the calls to these utilities from their code modules.
- Produced custom html formatted financial reports for the management staff (SQL, HTML).
- Provided technical support to application development teams. Conducted feasibility studies, contingency planning, and change impact analysis
- Supported web based registration system. Was ultimately responsible for database design and administration. Installed and configured Oracle 8i server on Sun Solaris OS.
- Controlled migrations of programs and database changes through the system development life cycle. Planed and implemented backup and recovery of the Oracle database.
