We provide IT Staff Augmentation Services!

Big Data Architect Resume

3.00/5 (Submit Your Rating)

NC

SUMMARY

  • Software professional with 12 years of experience in Big Data, FinTech and Technology Consulting.
  • Experience with Hadoop eco system, Spark components like HDFS, MapReduce, PIG and HIVE.
  • Extensive experience in developing and hosting applications in the cloud framework.
  • Well versed with ETL and data ingestion methods and strategies.
  • Seasoned techno/functional consultant with expertise in working with different stake holders, creating project roadmaps, collecting and documenting business requirements and translating them to technical specifications.

TECHNICAL SKILLS

Big Data Ecosystem: Hadoop, HDFS, Kafka, MapReduce, HIVE, PIG, Spark, HortonWorks

Database Technologies: Oracle, HBase, Microsoft SQL Server, MongoDB

Operating Systems: UNIX, Linux, Ubuntu

Methodology: Agile, SDLC

Languages: java, C#, Python, Scala

Other Tools: Eclipse, Toad, NetBeans, Elasticsearch, Azure, AWS, Maven

PROFESSIONAL EXPERIENCE

Confidential, NC

Big Data Architect

Responsibilities:

Identified 30 + data sources, designed efficient heavy data ingestion services to load them into the existing data lake. This more than doubled the data analytics capacity of the department, thereby directly impacting department revenues. Leading team in design and configuring HDFS ecosystem. Created and executed project road map by working with stake holders. Setting up a data lake and start feeding it all necessary data to be ingested into your target system.

Environment: AWS, Hadoop/HDFS, Python, Java, GIT

Confidential, New Brunswick, NJ

Big Data Developer

Responsibilities:

Designed and developed data pipeline to ingest large data sets, process and data analysis. Interacting with business to identify business requirements. Created functional and technical specifications. Load flat files and json data files in to Hadoop Data Lake. Maintain the Data lake in Hadoop by building data pipe line using java, Hive and Spark. Involved in Configuring EMR cluster in coordination with Internal AWS Environment team.

Environment: HDFS, Hadoop, java

Confidential, Greenwood Village, CO

Application Architect

Responsibilities:

Maintenance and troubleshooting of oracle RAC environment. Creating logical and physical models. Backing up and modifying data in different databases. Creating PL/SQL code for moving and modifying data. Working with users to identify business requirements. Created perl scripts to load data using SQL Performance tuning of queries and application tuning. Identifying bottlenecks and assist in creating project tasks and plans. Create and modify users, access privileges and permissions.

Environment: Oracle 11g, informatica, Erwin, MS Office, PRPC

Confidential, Westborough, MA

Consulting Systems Analyst

Responsibilities:

ERP support and maintenance using HP Quality Center ticketing system. SQL Server and Oracle development, administration and support for all store systems, creating and maintaining SSIS jobs based on requests for user groups. Worked with XML DB. Created SOAP based web services. Worked with corporate applications, created a business intelligence pipeline to access and run ad hoc reports that showed different views of corporate data. Administration of RTS (Retail transaction Switch), a network monitoring tool that acts as a gateway between banks, store and internal Refund and loss prevention systems. Administration and support of RMS (Refund Management system) and Aspect LP (Loss prevention) Administration and support of Remote ware server, an FTP server responsible for daily sales and settlement files from the stores and consolidating these files and pushing them to the main frame. Worked with Triversity and Global store, these systems are third part packages used on POS sale machines and the controllers that manage store operations from processing payments to end of day operations.

Environment: - Retail Transaction Switch, SQL server, oracle

Confidential, East Rutherford, NJ

Database Administrator

Responsibilities:

Used Er/Win to design structures and Meta data in the logical model and generated physical model. Created partitions using Er/Win in the logical model, generated script to be run in the physical model. Developed complex stored procedures to load data from external feed to staging and ODS layers. Unix data pump loads to export and import data and Meta data, writing procedures and -functions, testing queries for data quality. Administration of data stage jobs, creating direct data loads using Informatica.

Environment: - oracle10g/11g, Datastage8.1, Autosys, excel, putty, ftp, Cognos, Informatica

Confidential, Lewisville, TX

Database Developer

Responsibilities:

Created monthly-consolidated report in sql containing summarized loan transaction data, bad loans, collection call volume, customer interaction volumes etc. Created functional specification document to create Adhoc reports, Dashboard structures and web publishing reports Identified business requirements, created mapping documents, created test cases and issue tracking for Cognos reports for the business users of Defaults and downstream departments. Data collection and data analysis.

Environment: - SQL Server 2005, Autosys, excel

Confidential, NY

DBA / Database Developer

Responsibilities:

Provided ADM 24/7 support to the Contracts DW warehouse, identifying file load failures, data discrepancies, made crontab changes etc. Made modifications to the physical model of the warehouse, by changing the logical model in Erwin and re-engineered the physical model in the respective schema. Wrote UNIX shell scripts to import and export schemas. Created data backups periodically.

Environment: - unix, oracle10g

Confidential, South Brunswick, NJ

Database Developer

Responsibilities:

Created pl/sql stored procedure for consolidation effort between P&L accounts and billing systems. Wrote queries to fetch data between their trading and billing systems for report generation. Part of team implemented a trading system resulting in improved process times as well as utilization of system resources. Wrote requirements to generate xml files from the database for the business users. Performed unit testing on the in house developed trading system, validating data quality, performance.

Environment: - SQL Developer 2005, oracle10g

Confidential

Database Developer / Analyst

Responsibilities:

Wrote stored procedure to collect data using a cursor from the staging layer to the ODS layer and into the data mart to be stored as the master record. Recommended freezing loan codes and mapping them to future applications thereby eliminating the need to create redundant codes thereby improving online processing time considerably. Acted as onsite coordinator for an offshore team of 2 members. This involved task planning and documentation, Issue resolution, development tracking and UAT before code submission to VSS. Used data stage to bring data into the trading system from the billing systems for reconciliation purposes.

Environment: - Toad, oracle, SQL Server, excel, PowerPoint

Confidential

Database Designer / Modeler

Responsibilities:

Worked on Database Design (tables and referential integrity) from the ground up, created a high-level database design document by interacting with business user team for the Gross Profit application. Developed dimensional data modeling of the data warehouse to design the business process and apply business rules. Designed & implemented database securities plan to meet Sarbanes - Oxley regulation ensuring that the client’s systems were effectively aligned with federal regulations in a timely manner. Understand the business requirements for a system to help groups get the most effective system

Environment: - Toad, oracle10g, ER/Studio, Visio

We'd love your feedback!