North America / United States / IL / Chicago /

Technology & Engineering

#: 743999725582366 / 50240026

Associate

Full-Time

Job Description

Spark Developer – Chicago

YOU’LL BUILD TECH THAT EMPOWERS GLOBAL BUSINESSES

Our Connect Technology teams are working on our new Connect platform, a unified, global, open data ecosystem powered by Microsoft Azure. Our clients around the world rely on Connect data and insights to innovate and grow.

We’re looking for a Spark Developer, to help our talented, cross-functional team continue scaling Intelligence Studio to meet internal and external demand.

We use cutting edge technology and industry-leading data science to tackle some of the hardest problems in marketing science. We’re automating our data science methodologies with artificial intelligence and machine learning to produce the same quality insights as a traditional white-glove consulting engagement at unparalleled speed and scale.

Intelligence Studio is a horizontally scalable, cross-cloud technology-agnostic platform built with trusted open source components like Kubernetes, Spark, Airflow, MLflow, and TensorFlow. It allows data scientists to focus on doing data science by taking care of essential concerns like data access, logging, configuration, resource negotiation, dependency management, orchestration, and testing. This self-service, data science platform solution connects in with partners in a shared ecosystem, scales by usage, and has the building blocks to help our data scientists and clients move from creation to deployment of a data science project, at scale.

 WHAT YOU WILL BE DOING:

  • Build and troubleshoot software and integrations in a cloud-based Microservices environment for big data applications
  •  Actively participate in team code reviews and enforce quality standards
  • Work within a cross-functional team to author clear and purposeful epics/stories
  • Promote and enforce best practices in development and operations
  • Identify opportunities and weaknesses in the platform architecture 

WE ARE LOOKING FOR PEOPLE WITH:

  • Bachelor’s degree in Computer Science or a related technical field, or equivalent industry experience
  • 2-5 years of software development experience, preferably in an agile development environment
  • Strong experience in Spark development
  •  Experience in Scala, Flask, Big Data or cloud technologies preferred. 

We also use cloud software design, containerized Microservices & distributed caching, but you can learn this if you aren’t familiar with it.

Qualifications

https://jobs.smartrecruiters.com/TheNielsenCompany/743999725582366-spark-developer