SUMMARY

• Innovative and analytical professional with 13+ years of experience in software engineering, database development, and project management with strong knowledge of snowflake development.
• 4+ years of experience as Python Data Engineer 2 years of experience in Snowflake ETL and ELT data processing
• Good knowledge in Snowflake system hierarchy, cloning the database objects. Working knowledge in creating Internal/External stages and Data Shares in Snowflake. Experience in creating SnowPipes with Azure Blob Storage and automated with Azure Queues and Events. Strong Knowledge in Data Warehousing Concepts like star schema, snowflake, SCD Implementation, CDC and more. Experience in creating realtime data streams with SnowPipe and GCP PUP/SUB. Experience in automating data loads with Python SQLAlchemy, Snowflake Python Connector and Appworx.
• Experience in loading log data into HDFS using Kafka and performing ETL integrations. Experience in loading and processing CSV, JSON, Parquet and Avro files using Spark - SQL and DataFrame. Expert in transforming complex business logic into Database design and implemented by creating PL/SQL Stored Procedures, Functions and Views. Thorough knowledge on Hadoop ecosystem in Hive, Scoop, Pig and MapReduce. Experienced in importing and exporting the data using Sqoop from HDFS to Relational Database systems and vice-versa. Experience in reading data from Azure Data Lakes using Spark-SQL. Experience in optimizing Hive-SQL queries and Spark Jobs.
• Experience in Creating and maintaining multi-node cluster in Azure DataBricks. Experience in analysing and visualizing data in DataBricks Jupiter Notebooks. Experience in creating data flows and pipelines in Azure Data Factory. Experience in creating and loading data into Hive tables with appropriate static and dynamic partitions, intended for efficiency.
• Experience in creating web applications using Python Flask. Experience in Automating outlook email responses with Python OS, BeautifulSoap and CX Oracle modules. Extensively used Pandas, Numpy, SQLAlchemy to develop python solutions and automated with appworx.
• Expert in working with Data Stage Manager, Designer, Administrator, and Director. Proven track record in troubleshooting of Data Stage jobs and addressing production issues like performance tuning and enhancement.
• Experience in collecting business requirements, writing functional requirements and test cases and creating technical design documents.
• Excellent communication skills, interpersonal skills, problem solving skills, and a very good team player along with can do attitude and ability to effectively communicate with all levels of the organization such as technical, management and customers.

TECHNICAL SKILLS

Cloud Technologies: Azure, Snowflake, Google Cloud Platform (GCP), AWS

Big Data Technologies: Cloudera, Map Reduce, Hive, PIG, Sqoop, Flume, Spark, Kafka, Oozie, Hue, Impala, Zookeeper

Programming Languages: Java, Python, Scala, T-SQL, SQL, PL/SQL, UNIX Shell Script

RDBMS: Oracle 12c/11g/10g/9i/8i/7x, MongoDB, Firebase, MySQL 5.2, MS SQL Server 2016/2014/2012/ 2008 R2/ 2008ETL Tools DataStage.

Operating Systems: UNIX, Linux, Windows XP/2K/NT/7/10

Languages: T-SQL, SQL, PL/SQL, UNIX Shell Script, Python, Scala, Java/J2EE, C, C++.

Source Control: SVN, TFS, Git

Tools: Cloudera Hue, SQL Developer, DB Visualizer 9.5.6, Toad7/9/10/11, PL/SQL Developer7/8/9/10.Pycharm, IntelliJ, Eclipse, Visual Studio code, JIRA, ITSM

PROFESSIONAL EXPERIENCE

Confidential, Lewisville, TX

Software Developer Lead

Responsibilities:

• Developed multiple Python scripts to read/write data using Snowflake connector.
• Created SnowPipes to continuously read data into Snowflake databases from Azure Blob storage.
• Created Data shares and Secure Views in SnowFlake for BI team for their reporting.
• Worked on importing and exporting data from Snowflake, Oracle and DB2 into HDFS and HIVE using Sqoop for analysis, visualization and to generate reports.
• Designed and Developed PL/SQL Objects like Procedures, Functions, Triggers and Packages.
• Worked on creating Spark RDD's and Data Frames applying operations like Transformation & Actions.
• Automated data processing using SQLAlchemy, Pandas and Numpy, which saved 200 hrs of business efforts a year.
• Loaded 100s of daily interval data files into HDFS and processed using Spark-SQL to source data to Oracle and SnowFlake databases.
• Automated over 40 manual processes of handling data and developed automated processes that saved time and effort for both business users and developers.
• Implemented 10s of optimized solutions that gave users the best experience.
• Stabilized the system, minimized the call volumes over time with small enhancements and proper tracking of root causes.

Confidential

Software Developer Lead

Responsibilities:

• Designed and developed PL/SQL Packages, Procedures, Functions and triggers
• Designed database schemas with best practices implemented.
• Designed and developed internal accounting application using Oracle APEX.
• Fine-tuned queries and database objects to deliver the best performance.
• Conducted brainstorming meetings in order to identify risks and postproduction issues.
• Managed and developed multiple applications using Oracle PL/SQL and Java/J2EE.
• Analysed and reported client/customer data using large data sets like transactional and analytical data to meet business objectives
• Monitored data loads and other process jobs
• Prepared detailed design documents and post-production observations as lessons learned.
• Led offshore team of 6 and trained them to align project needs.