Big Data Architect Resume
NC
SUMMARY
- Software professional with 12 years of experience in Big Data, FinTech and Technology Consulting.
- Experience with Hadoop eco system, Spark components like HDFS, MapReduce, PIG and HIVE.
- Extensive experience in developing and hosting applications in the cloud framework.
- Well versed with ETL and data ingestion methods and strategies.
- Seasoned techno/functional consultant with expertise in working with different stake holders, creating project roadmaps, collecting and documenting business requirements and translating them to technical specifications.
TECHNICAL SKILLS
Big Data Ecosystem: Hadoop, HDFS, Kafka, MapReduce, HIVE, PIG, Spark, HortonWorks
Database Technologies: Oracle, HBase, Microsoft SQL Server, MongoDB
Operating Systems: UNIX, Linux, Ubuntu
Methodology: Agile, SDLC
Languages: java, C#, Python, Scala
Other Tools: Eclipse, Toad, NetBeans, Elasticsearch, Azure, AWS, Maven
PROFESSIONAL EXPERIENCE
Confidential, NC
Big Data Architect
Responsibilities:
Identified 30 + data sources, designed efficient heavy data ingestion services to load them into the existing data lake. This more than doubled the data analytics capacity of the department, thereby directly impacting department revenues. Leading team in design and configuring HDFS ecosystem. Created and executed project road map by working with stake holders. Setting up a data lake and start feeding it all necessary data to be ingested into your target system.Environment: AWS, Hadoop/HDFS, Python, Java, GIT
Confidential, New Brunswick, NJ
Big Data Developer
Responsibilities:
Designed and developed data pipeline to ingest large data sets, process and data analysis. Interacting with business to identify business requirements. Created functional and technical specifications. Load flat files and json data files in to Hadoop Data Lake. Maintain the Data lake in Hadoop by building data pipe line using java, Hive and Spark. Involved in Configuring EMR cluster in coordination with Internal AWS Environment team.Environment: HDFS, Hadoop, java
Confidential, Greenwood Village, CO
Application Architect
Responsibilities:
Maintenance and troubleshooting of oracle RAC environment. Creating logical and physical models. Backing up and modifying data in different databases. Creating PL/SQL code for moving and modifying data. Working with users to identify business requirements. Created perl scripts to load data using SQL Performance tuning of queries and application tuning. Identifying bottlenecks and assist in creating project tasks and plans. Create and modify users, access privileges and permissions.Environment: Oracle 11g, informatica, Erwin, MS Office, PRPC
Confidential, Westborough, MA
Consulting Systems Analyst
Responsibilities:
ERP support and maintenance using HP Quality Center ticketing system. SQL Server and Oracle development, administration and support for all store systems, creating and maintaining SSIS jobs based on requests for user groups. Worked with XML DB. Created SOAP based web services. Worked with corporate applications, created a business intelligence pipeline to access and run ad hoc reports that showed different views of corporate data. Administration of RTS (Retail transaction Switch), a network monitoring tool that acts as a gateway between banks, store and internal Refund and loss prevention systems. Administration and support of RMS (Refund Management system) and Aspect LP (Loss prevention) Administration and support of Remote ware server, an FTP server responsible for daily sales and settlement files from the stores and consolidating these files and pushing them to the main frame. Worked with Triversity and Global store, these systems are third part packages used on POS sale machines and the controllers that manage store operations from processing payments to end of day operations.Environment: - Retail Transaction Switch, SQL server, oracle
Confidential, East Rutherford, NJ
Database Administrator
Responsibilities:
Used Er/Win to design structures and Meta data in the logical model and generated physical model. Created partitions using Er/Win in the logical model, generated script to be run in the physical model. Developed complex stored procedures to load data from external feed to staging and ODS layers. Unix data pump loads to export and import data and Meta data, writing procedures and -functions, testing queries for data quality. Administration of data stage jobs, creating direct data loads using Informatica.Environment: - oracle10g/11g, Datastage8.1, Autosys, excel, putty, ftp, Cognos, Informatica
Confidential, Lewisville, TX
Database Developer
Responsibilities:
Created monthly-consolidated report in sql containing summarized loan transaction data, bad loans, collection call volume, customer interaction volumes etc. Created functional specification document to create Adhoc reports, Dashboard structures and web publishing reports Identified business requirements, created mapping documents, created test cases and issue tracking for Cognos reports for the business users of Defaults and downstream departments. Data collection and data analysis.Environment: - SQL Server 2005, Autosys, excel
Confidential, NY
DBA / Database Developer
Responsibilities:
Provided ADM 24/7 support to the Contracts DW warehouse, identifying file load failures, data discrepancies, made crontab changes etc. Made modifications to the physical model of the warehouse, by changing the logical model in Erwin and re-engineered the physical model in the respective schema. Wrote UNIX shell scripts to import and export schemas. Created data backups periodically.
Environment: - unix, oracle10g
Confidential, South Brunswick, NJ
Database Developer
Responsibilities:
Created pl/sql stored procedure for consolidation effort between P&L accounts and billing systems. Wrote queries to fetch data between their trading and billing systems for report generation. Part of team implemented a trading system resulting in improved process times as well as utilization of system resources. Wrote requirements to generate xml files from the database for the business users. Performed unit testing on the in house developed trading system, validating data quality, performance.Environment: - SQL Developer 2005, oracle10g
Confidential
Database Developer / Analyst
Responsibilities:
Wrote stored procedure to collect data using a cursor from the staging layer to the ODS layer and into the data mart to be stored as the master record. Recommended freezing loan codes and mapping them to future applications thereby eliminating the need to create redundant codes thereby improving online processing time considerably. Acted as onsite coordinator for an offshore team of 2 members. This involved task planning and documentation, Issue resolution, development tracking and UAT before code submission to VSS. Used data stage to bring data into the trading system from the billing systems for reconciliation purposes.Environment: - Toad, oracle, SQL Server, excel, PowerPoint
Confidential
Database Designer / Modeler
Responsibilities:
Worked on Database Design (tables and referential integrity) from the ground up, created a high-level database design document by interacting with business user team for the Gross Profit application. Developed dimensional data modeling of the data warehouse to design the business process and apply business rules. Designed & implemented database securities plan to meet Sarbanes - Oxley regulation ensuring that the client’s systems were effectively aligned with federal regulations in a timely manner. Understand the business requirements for a system to help groups get the most effective systemEnvironment: - Toad, oracle10g, ER/Studio, Visio