Sr. Data Engineer Resume
San Francisco, CA
SUMMARY:
- An accomplished Information Technology management professional with over 15 years of comprehensive experience in database/web multilayer application development using different RDBMS(Sql Server,Oracle,Sybase), Informatica, APIGEE, Tableu,Perl, Python, Java, C# etc. Highly knowledgeable in all IT areas as well as business principles and processes.
- An understanding, innovative individual who has an excellent sense of teamwork to get results by instilling commitment, trust, fairness and loyalty.
- Excellent technology learning.
- Strong knowledge of RDBMS (db. Optimization, store procedure, triggers), data warehouse with Terabytes of data.
- Demonstrated expertise utilizing ETL tools, including Informatica, SQL Server Integration Services (SSIS), and ETL using programming language, and RDBM systems like SQL Servers, Oracle and Sybase IQ.
- Operating system used DOS, Window, Unix and Linux
- Database modeling experience.
- Jobs automation tools like SQL Server Agent, Autosys, Crontab and Tivoli.
- Experience with Secured Shell, TCP/IP and other network concept.
- Knowledge of every step of SDLC and OOD.
- Experience with SOX and other programming and documentation standards.
- Familiar Web - services concept and integration solutions.
- Messaging techniques IBM MQ Series.
- Experience of the offshore co-ordination, managerial task like team management and performance reviews.
- Familiar with Data science, AWS, NoSQL, Elasticsearch, Predictions Algorisms, Hadoop, Hbase etc.
TECHNICAL SKILLS:
Database: Sybase, Oracle 12i,Sql Server 2014/2008/6.5, Access, Informix and Cache.1
Languages: Perl, Java, Python, C++, C#
GUI Tools: Visual Basic .Net, Power Builder
Internet: Web services, Curl, Junit,Java Scripts, JSON, Flask, HTML, XML, ADO and JSQL, Sockets
Messaging: MQ series
Mainframe: Total System, NDM jobs, Job submitter.
Scheduler: SQL Server Agent, Tivoli, Crontab, nightjobs
Reports: Tableau, Crystal Report, Business Object, Oracle Report Writer
Project Management: Jira, Source Forge, Remedy
DB Access Tools: SSMS, Aqua data studio, Toad
Data Virtualization: Denondo
PROFESSIONAL EXPERIENCE:
Confidential
Sr. Data Engineer
Technology: APIGEE, Denodo, Informatica, Oracle, MS Sql Server, Webservices, Tableau, Autosys, Jira,Jenkins, Udeploy, SVN,Cognos
Responsibilities:
- Design and developed data loader developed using APIGEE, Denodo, Informatica, Oracle.
- Setup new api proxy from the scratch to read data from the multiple webservice, generate report and post it to external site.
- Process high volume payload web-services. Also use lots of different policy like SpikeArrest, Keyvalue map, JSON to XML conversion,APIKey.
- All the custom application policy logic written in the Java Scripts.
- Create denodo view from the HR database table based to pull list of the user based on the department group.
- Test all the Denodo published web service for version 6.0 upgrade.
- Setup SSO for the third-party vendor products.
- Create Tableau report to merge inhouse gift and entertainment data with the concur data.
- Created Technical design docs for the database and for the operational application support.
Confidential
Data Engineer/Production Support Engineer
San Francisco,CA
Responsibilities:
- Database software development functions using Python/Perl/Sybase/Autosys /Java etc.
- Design database layout by normalizing data of xml feed IDC security master data. Write Python based data loader to parse xml file and load the data into database.
- Library argparse,datetime,logging, os,random, re,sys,tempfile used in PYTHON.
- Help build/train offshore team in Singapore/India.
- Perform unit testing using different test cases and work with business user for UAT.
- Extract data from the different source of SQL Server database, Vendor ftp sites and websites.
- Transform extracted data and load it database using different data loading tool like bcp, Sql *Loader etc.
- Maintained and support publisher service of loaded data (Security Master,Pricing,Index) to downstream systems.
- Help resolve consumer service data issue for the downstream clients.
- Participate in the development projects and vendor changes for the data loaders.
- Resolve the performance issue of the application by doing tuning of the applications.
- Resolve day to day issue in the production with sort term/long term solution.
- Reply the query from users regarding data or issue.
- Support the database maintenance / infrastructure changes related work on weekends.
- Responding to and resolving problems communicated via email, telephone call, error logs, and reports generated by scheduled jobs within the Project Team's responsibility
- Communicating with users and data vendors, problem logging, tracking and escalation, incident reporting, and problem resolution (diagnose and repair.)
- Researching and making/identifying appropriate recommendations for proposed upgrades that would impact job streams within their responsibility
- Involved in the development of the web based Data Quality Report framework and in-house dashboard to give alert for exception with data.
- Working with global team development as well as major production maintenance.
- Took in-house training on Elastic Search, No SQL, HBase, Hive, HDFS data Science tools.
Confidential
Level C Team Lead/Manager
Responsibilities:
- Designing, developing and maintaining software for the products (Supported Products), in accordance with requirements provided by Confidential
- Developing test plans, test scripts, test cases and expected results at the direction of Confidential .
- Turning over the tested product from the QA/Test environment into the production environment, in accordance with Confidential 's turnover procedures
- Write status reports, as directed by Confidential manager or Confidential Unit Lead;
- Attend, and/or provide input to, regular status meetings, or other, team meetings, as directed by the Confidential manager or Confidential Unit Lead.
- Provide Level 2 operational support for Referential Data which includes
- Responding to and resolving problems communicated via email, telephone call, beep, error logs, and reports generated by scheduled jobs within the Project Team's responsibility
- Communicating with users and data vendors, problem logging, tracking and escalation, incident reporting, and problem resolution (diagnose and repair.)
- Researching and making/identifying appropriate recommendations for proposed upgrades that would impact job streams within their responsibility.
- Performance review for the reporting people.