We provide IT Staff Augmentation Services!

Sr. Data Engineer Resume

5.00/5 (Submit Your Rating)

San Francisco, CA

SUMMARY:

  • An accomplished Information Technology management professional with over 15 years of comprehensive experience in database/web multilayer application development using different RDBMS(Sql Server,Oracle,Sybase), Informatica, APIGEE, Tableu,Perl, Python, Java, C# etc. Highly knowledgeable in all IT areas as well as business principles and processes.
  • An understanding, innovative individual who has an excellent sense of teamwork to get results by instilling commitment, trust, fairness and loyalty.
  • Excellent technology learning.
  • Strong knowledge of RDBMS (db. Optimization, store procedure, triggers), data warehouse with Terabytes of data.
  • Demonstrated expertise utilizing ETL tools, including Informatica, SQL Server Integration Services (SSIS), and ETL using programming language, and RDBM systems like SQL Servers, Oracle and Sybase IQ.
  • Operating system used DOS, Window, Unix and Linux
  • Database modeling experience.
  • Jobs automation tools like SQL Server Agent, Autosys, Crontab and Tivoli.
  • Experience with Secured Shell, TCP/IP and other network concept.
  • Knowledge of every step of SDLC and OOD.
  • Experience with SOX and other programming and documentation standards.
  • Familiar Web - services concept and integration solutions.
  • Messaging techniques IBM MQ Series.
  • Experience of the offshore co-ordination, managerial task like team management and performance reviews.
  • Familiar with Data science, AWS, NoSQL, Elasticsearch, Predictions Algorisms, Hadoop, Hbase etc.

TECHNICAL SKILLS:

Database: Sybase, Oracle 12i,Sql Server 2014/2008/6.5, Access, Informix and Cache.1

Languages: Perl, Java, Python, C++, C#

GUI Tools: Visual Basic .Net, Power Builder

Internet: Web services, Curl, Junit,Java Scripts, JSON, Flask, HTML, XML, ADO and JSQL, Sockets

Messaging: MQ series

Mainframe: Total System, NDM jobs, Job submitter.

Scheduler: SQL Server Agent, Tivoli, Crontab, nightjobs

Reports: Tableau, Crystal Report, Business Object, Oracle Report Writer

Project Management: Jira, Source Forge, Remedy

DB Access Tools: SSMS, Aqua data studio, Toad

Data Virtualization: Denondo

PROFESSIONAL EXPERIENCE:

Confidential

Sr. Data Engineer

Technology: APIGEE, Denodo, Informatica, Oracle, MS Sql Server, Webservices, Tableau, Autosys, Jira,Jenkins, Udeploy, SVN,Cognos

Responsibilities:

  • Design and developed data loader developed using APIGEE, Denodo, Informatica, Oracle.
  • Setup new api proxy from the scratch to read data from the multiple webservice, generate report and post it to external site.
  • Process high volume payload web-services. Also use lots of different policy like SpikeArrest, Keyvalue map, JSON to XML conversion,APIKey.
  • All the custom application policy logic written in the Java Scripts.
  • Create denodo view from the HR database table based to pull list of the user based on the department group.
  • Test all the Denodo published web service for version 6.0 upgrade.
  • Setup SSO for the third-party vendor products.
  • Create Tableau report to merge inhouse gift and entertainment data with the concur data.
  • Created Technical design docs for the database and for the operational application support.

Confidential

Data Engineer/Production Support Engineer

San Francisco,CA

Responsibilities:

  • Database software development functions using Python/Perl/Sybase/Autosys /Java etc.
  • Design database layout by normalizing data of xml feed IDC security master data. Write Python based data loader to parse xml file and load the data into database.
  • Library argparse,datetime,logging, os,random, re,sys,tempfile used in PYTHON.
  • Help build/train offshore team in Singapore/India.
  • Perform unit testing using different test cases and work with business user for UAT.
  • Extract data from the different source of SQL Server database, Vendor ftp sites and websites.
  • Transform extracted data and load it database using different data loading tool like bcp, Sql *Loader etc.
  • Maintained and support publisher service of loaded data (Security Master,Pricing,Index) to downstream systems.
  • Help resolve consumer service data issue for the downstream clients.
  • Participate in the development projects and vendor changes for the data loaders.
  • Resolve the performance issue of the application by doing tuning of the applications.
  • Resolve day to day issue in the production with sort term/long term solution.
  • Reply the query from users regarding data or issue.
  • Support the database maintenance / infrastructure changes related work on weekends.
  • Responding to and resolving problems communicated via email, telephone call, error logs, and reports generated by scheduled jobs within the Project Team's responsibility
  • Communicating with users and data vendors, problem logging, tracking and escalation, incident reporting, and problem resolution (diagnose and repair.)
  • Researching and making/identifying appropriate recommendations for proposed upgrades that would impact job streams within their responsibility
  • Involved in the development of the web based Data Quality Report framework and in-house dashboard to give alert for exception with data.
  • Working with global team development as well as major production maintenance.
  • Took in-house training on Elastic Search, No SQL, HBase, Hive, HDFS data Science tools.

Confidential

Level C Team Lead/Manager

Responsibilities:

  • Designing, developing and maintaining software for the products (Supported Products), in accordance with requirements provided by Confidential
  • Developing test plans, test scripts, test cases and expected results at the direction of Confidential .
  • Turning over the tested product from the QA/Test environment into the production environment, in accordance with Confidential 's turnover procedures
  • Write status reports, as directed by Confidential manager or Confidential Unit Lead;
  • Attend, and/or provide input to, regular status meetings, or other, team meetings, as directed by the Confidential manager or Confidential Unit Lead.
  • Provide Level 2 operational support for Referential Data which includes
  • Responding to and resolving problems communicated via email, telephone call, beep, error logs, and reports generated by scheduled jobs within the Project Team's responsibility
  • Communicating with users and data vendors, problem logging, tracking and escalation, incident reporting, and problem resolution (diagnose and repair.)
  • Researching and making/identifying appropriate recommendations for proposed upgrades that would impact job streams within their responsibility.
  • Performance review for the reporting people.

We'd love your feedback!