Data Engineer Resume St Peters, MO - Hire IT People

SUMMARY

Over 2 years of IT experience and technical proficiency involving Business Requirement Analysis, Application Design, Data Modelling, Development, testing and Documentation.
Experienced working in versatile software development methodologies including Agile/Scrum, and Waterfall SDLC methodologies.
Strong analytical skills and expertise in offering end - to-end solutions in quick turnaround time
Quick learner; attention to detail; successful working in both team and self-directed environment.

TECHNICAL SKILLS

Hadoop Ecosystem: HDFS, Apache Spark, Apache Airflow.

Business Intelligence Tools: Power BI, Business Objects

Google Cloud Platform: GCS, Big Query, Dataflow

Languages: Python, SQL, HTML

Databases: MS SQL Server,Oracle, MySQL, Big Query

Operating Systems: Windows, Linux, Mac

Others: JIRA, Visual Studio, GitHub, Bitbucket, CICD-Jenkins.

PROFESSIONAL EXPERIENCE

Data Engineer

Confidential, St Peters, MO

Responsibilities:

ETL(Extract, Transform, Load) data from various source systems and load them to GCS.
Created data pipelines with Airflow, populating Data Lakes in GCP - Big Query.
Implemented robust and scalable data pipelines using Python, SQL, parallel processing frameworks, and other GCP cloud solutions.
Responsible for designing the pipelines that parse data from various file formats, followed by processing and loading them to GCP.
Hadoop Shell commands to manage HDFS.
Knowledge on utilizing Linux operating system.
Knowledge on GitHub and Branching Strategies.

Environment: Agile, Airflow, GCP, Linux, HDFS, Python, SQL, GitHub

IT Analyst

Confidential

Responsibilities:

Ensured the concepts of Data Extraction, Data Standardization, Data Validation and System Maintenance.
Providing several Business Intelligence Solutions to the organization with data extraction, mining, report creation and standardization.
Provided expertise in data storage structures, data mining, and data cleansing.
Creating and following processes to keep data confidential.
Developed and executed consisted practices to ensure Data Standardization.
Collaborated with various stakeholders and created intuitive reports upon requests to meet business needs.
Regularly reviewed reports, and other integrations for data integrity and functional errors and ensured System Validation.
Ensured data accuracy through the creation and implementation of data integrity queries in SQL
Conducted security research in keeping abreast of latest security issues
Gathered data from incidents that had been remedied for careful review and analysis to prevent future events
Deep analysis of incidents using SIEM and other tools.
Identified security weaknesses and vulnerabilities in-state applications and systems.
Performed vulnerability scans on servers and websites.
Worked on infected hosts and giving remediation to get them cleaned.
Endpoint management and handling.

Environment: Data Mining, Data Standardization, Data Cleansing, SIEM, Wireshark, ServiceNow.