Job ID :
Company :
Internal Postings
Location :
Type :
Duration :
7-8 Month Contract
Salary :
Status :
Openings :
Posted :
09 Feb 2018
Job Seekers, Please send resumes to
  • Our client - a major media and entertainment firm located in NYC - has an immediate need for a Data Engineer.
Position Description:
  • The Data Engineer will be responsible for partnering with Revenue Analytics to onboard and optimize datasets which will be used in the Looker digital analytics platform. To be successful in the role you'll need to be intellectually curious, detail-oriented, open to new ideas, and possess a strong aptitude for quantitative methods. The role requires a strong statistical background, familiarity with modern data warehouses, experience with SQL-like tools, and knowledge of scripting languages (e.g., Python). Experience with predictive modeling or machine learning a plus.
Job Duties:
  • Create solutions to transform data from various sources and load it into platforms such as Hadoop to create a data lake
  • Create and maintain transformations to summarize/aggregate data and load these so users can consume this data using various BI/Analytics tools.
  • Develop and maintain standards for administration and operation including the scheduling, running, monitoring, logging, management of errors, recovery from failures, and validation of outputs.
  • Contribute to the project planning process by estimating tasks and deliverables.
  • Work closely with Revenue Analytics team members to understand user requirements.
  • Be at the cutting edge of utilizing data about consumers in the media industry to improve audience experience.
  • Help out with complex analytical tasks.
Required Skills:
  • 4+ years solid experience as a database developer in OLAP environment.
  • BS in computer science, math, physics or equivalent education/training/experience.
  • Experience with ETL's & Data pipelines
  • Experience performing QC & cleaning up dirty data
  • Experience with a "big data” platform such as Hadoop, NoSQL DB's or cloud based tools such as Amazon Redshift.
  • Experience with Hive and HiveQL
  • Experienced and comfortable with Unix/Linux operating systems
  • Expert knowledge in SQL, Python and shell scripting
  • Ability to work independently and take on projects
Additional skills desired:
  • Knowledge of SparkQL and/or Postgress SQL would be ideal
  • Prior understanding and/or experience within a media and entertainment business, ad tech and related data.
  • Experience with media, Web analytics and consumer data systems is highly desired.
Key aspects of the position:
  • Experience with ETLs and data pipelines
  • Experience with SQL-like big data query languages, HIVE in particular
  • Experience in Python
  • Experience working in UNIX.