Job Seekers, Please send resumes to firstname.lastname@example.orgDetailed Job Description:
- 4+ years work experience as aPythonData Engineer or similar role
- 2+ years of hands - on development experience in Azure Data bricks
- 2 years experience withSpark
- Previous experience with the Snowflake database management system
- Experience with big data tools: Hadoop,Spark, Kafka, etc.
- Experience with stream-processing systems: Storm,Spark-Streaming, etc.
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Experience building and optimizing big data data pipelines, architectures and data sets.
- Strong analytic skills related to working with unstructured datasets.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- Hands-on implementation experience in manipulating, processing and extracting value from large disconnected datasets.
- Working knowledge of message queuing, stream processing, and highly scalable big data data stores.
- Strong engineer with ability to abstract our core/repeated requirements into a build-once, configurable framework
Experience required: 4 Years