Big Data Technologist Resume
SUMMARY:
- Software/Data Engineer/Analyst with more than a decade of experience in development, testing and implementation of application software in Big Data platform and Oracle using SDLC and Agile methodologies in development, migration, production support and maintenance environments
- Experience in ETL, OLTP and Datawarehouse environments using different technologies
- Served as a liaison between Business Stakeholders, Application Development Teams and Program Managers to ensure deliverables from inception to completion
- Received customer appreciations from multiple clients, employers and “Magnet of Team” award for customer satisfaction at Oracle, Cognizant, etc
- Hands on experienced professional looking for opportunities to use Big Data and Oracle technologies for business processes
TECHNICAL SKILLS:
Languages: Python (Pandas, Pygrametl, etc), Scala, Hive, Oracle PL/SQL, Oracle Forms, Oracle Reports Oracle Discoverer, Shell scripting, Perl, JSP, HTML, Uniface, C, Cobol, BASIC, FORTRAN
Database: HDFS, Oracle 8i/9i/10g/11g, Mongo DB, Cassandra, MySQL, IBM DB2
Big Data Platform: Hadoop, Spark (Spark SQL, Scala, etc), AWS (S3), Data Science, IoT
Tools: Apache products like Hive, Drill, Zeppelin, Jupyter, PIG, Impala, Kafka, Tableau, Oracle E - business Suite, OBIEE, Oracle Queues, Primavera, TOAD, PL/SQL Developer, ERWIN, Rally, JIRA, Footprints, custom reporting tools, Baan, SAP, Facets
ETL: Python, Hive, Sqoop, PL/SQL, SQL Loader, Shell Scripting, Datastage, Informatica, etc
Operating System: Windows, Sun Solaris, Unix, Linux
System Environment: OLTP, Datawarehouse using Big Data and Oracle technologies
Version Control: Visual SourceSafe, CVS, PVCS, Subversion, Perforce
General awareness: Agile, HIPAA, CMM Level 5, Sarbanes Oxley Act
PROFESSIONAL EXPERIENCE:
Confidential
Big Data Technologist
- Undertook online and classroom training from multiple vendors like Cloudera, MapR, Hortonworks, SAP etc
- Implemented and got hands on experience for Big Data technologies on free VMs provided by open source vendors
- Performed hands on tests implementing Oracle technology concepts using Big Data technologies
- Identified areas for technical training workshops and arranged them as part of Core Training Committee
- Attended meetups and summits for different Big Data Technologies in San Francisco Bay area
Big Data Consultant
- Reengineered code to automate transformations and data pipelines to increase business productivity as a result of being able to make decisions based on real time data
- Lead complete SDLC for the ETL development effort for sourcing data in different formats (JSON, Csv, etc) from multiple sources/databases like HDFS, Oracle, MySQL, Cassandra into target schema for reporting using Big Data technologies like Spark
- Designed and implemented fast and efficient data acquisition using Big Data processing techniques with Big Data tools like Hive, Spark reducing data loading time for Data Lake from 18 hours to 2 hours
- Responsible to identify tools and technologies to be used from Big Data stack for preparing the BRD, technical specifications and participated to develop ETL environment, processes, programs, and scripts to acquire data from source systems to populating target system followed by feeding to datawarehouse
- Designed, created and delivered dashboards with meaningful insights after identifying their needs and wants, helping Sales and Marketing teams to target customers effectively and efficiently using Tableau
- Designed generic extensive framework using Python libraries like pygrametl to load data from multiple sources into Data Lake
- Participated in functional and technical design reviews, preparation of test data, peer code reviews and improving processes and reports, reducing bug count by 25%
- Carried out processing, cleansing, and verification of integrity of data used for data analysis, integration
Senior Application Developer
- Achieved real time reporting for analytics eliminating wait time of 1 day enabling marketing sales teams to react to consumer and market changes rapidly to make profitable decisions
- Designed, created, modified, performed tuning of application and products increasing profits and customer satisfaction as a result of extensive brainstorming, interaction and testing with different teams
- Designed, developed, modified and tested Analytics reports after discussion with stakeholders, customers and teams and implemented them efficiently resulting in increased customer satisfaction
- Created test plans for different applications and helped resolve application issues for customers improving customer efficiency and reducing organization training expenses
- Created and modified pipelines for extraction, transformation and loading of data as per analytics reporting requirements
Application Developer/Engineer
- Worked in a cross-functional environment with product management, engineering leadership and data scientists to architect, design and develop on coming up with new product ideas, and turn that vision into working products
- Increased profits for business and teams by designing processes using partitioning techniques to eliminate job delays due to batch jobs with performance issues eliminating manual monitoring and intervention
- Developed code and custom interfaces using different databases for applications in Java and Oracle
- Developed, maintained and tested code for extraction, transformation and loading of data from multiple sources into databases
- Carried out performance tuning of datawarehouse, Informatica and Datastage queries for improved performance
- Performed various activities related to migration of tables between legacy systems and various sources and databases for data migration projects ensuring reports are available in 1 hour instead of waiting for batch processes taking 2 days
- Created users/schemas, carried out export/import and other database engineering activities
Application Developer
- Worked on customizing the product and production support for multiple clients
- Developed and modified PL/SQL code and database objects like procedure, function, triggers etc for enhancements in various modules using features like partitions, collections, dynamic SQL, etc
- Developed and modified reports using OBIEE and Oracle Reports
- Developed, modified and enhanced various modules by developing interfaces using Oracle Forms
- Created test plans, identified and resolved the performance issues in application for various clients
Software Engineer
- Translated business requirements into creation, development and modification of database objects and PL/SQL code resulting in increased customer satisfaction and efficient business processes
- Created and modified database ETL jobs, UNIX shell scripts, custom utilities & Cron jobs
- Performed analysis, design, development and implementation for migration of ERP system from Baan to SAP
- Identified areas of performance tuning for PL/SQL code and resolved performance issues in them
- Developed JSP codes, implemented content and display changes in application depending on business user requests
- Drastically cut down the processing time of generating reports by denormalizing the data as required
- Performed Quality Assurance activities and fixed bugs in application after troubleshooting within tight deadlines