Lead Data Engineer Job at Technology Recruiting Services, Oakland, CA

bG5wWVdOSzhsZmNCNUpFd0MvUDAvdDBIQ2c9PQ==
  • Technology Recruiting Services
  • Oakland, CA

Job Description

***Must be located in the SF Bay Area or your application will not be considered***

Our client is a venture-backed SaaS startup that recently secured Series A funding. They're solving a multi-billion dollar problem of data quality for the entire marketing industry. Their platform enables major brands and publishers to optimize consumer data quality, improving marketing ROI. In a fast-paced and collaborative environment, they are committed to excellence and innovation.

Key Responsibilities:

  • Design and maintain scalable data pipelines using Spark and AWS EMR for processing terabytes of consumer data
  • Write, test, and optimize custom Scala code for ETL workflows
  • Deploy and manage ETL processes in AWS cloud environments using Airflow
  • Automate delivery of structured data to enterprise clients via Snowflake and Databricks
  • Collaborate with the Data Science team to optimize data infrastructure
  • Contribute to data modeling efforts using SQL for efficient large-scale data management
  • Create monitoring tools and KPIs using Tableau to ensure data pipeline health
  • Maintain comprehensive documentation for internal teams and external clients

Tech Stack: AWS (EMR, EC2, S3, Athena, Sagemaker), Spark, DBT, Snowflake, Databricks, Airflow, Terraform, Github, Tableau

Programming Languages: Scala, Python, SQL, and Bash

Requirements

  • 5-7 years of relevant work experience (3-5 years considered)
  • Strong SQL and Scala skills
  • Experience with cloud computing tools (e.g., Spark, AWS EMR, Snowflake, Databricks)
  • Proficiency in data modeling and distributed data processing
  • Excellent communication skills, including explaining complex concepts to non-technical stakeholders

An ideal candidate will:

  • Thrives in a fast-paced startup, embracing high-impact responsibilities with minimal oversight
  • Strong communicator, adept at explaining complex data concepts to diverse stakeholders
  • Passionate about solving data quality challenges in marketing, with relevant industry experience
  • Committed to long-term growth, excited by potential for ownership and future team leadership

Benefits

Compensation:

  • Salary range: $160,000 - $180,000
  • Stock options package
  • Full health benefits and 401k

Work Environment:

  • Hybrid model: 3 days in office, 2 days remote, on average
  • Small, high-impact team with plans for growth
  • Report directly to the Head of Data Science

Job Tags

Full time, Work experience placement, Remote job,

Similar Jobs

TGA Premier Sports

Youth Sports Enthusiast Inspire and Coach Tennis, Golf and Pickleball Job at TGA Premier Sports

 ...Job Description Job Description TGA Premier Sports is seeking a Youth Sports Enthusiast to inspire and coach tennis and golf for kids. In this role, you will work with children ages 5-14+ to help them develop their athletic skills while also encouraging academic learning... 

SynergisticIT

Junior Full-Stack Developer Job at SynergisticIT

 ...union, Client, visa, walmart lab s etc to name a few.Currently, we are looking for entry-level software programmers, Java Full stack developers, Python/Java developers, Data analysts/ Data Scientists, Data Engineers, Machine Learning engineers for full time positions... 

Merrimack School District

Special Education Coordinator Job at Merrimack School District

 ...Position Type: Middle School Teaching/Special Education Coordinator Date Posted: 11/6/2024 Location: Merrimack Middle School Date Available: ASAP Merrimack Middle School is seeking an experienced candidate with the ability to collaborate with a special... 

The Premiere Group

Executive Assistant Job at The Premiere Group

 ...We are seeking a highly organized and proactive Executive Assistant to support the CEO, enabling efficient accomplishment of key tasks...  ...in advance. Complete adhoc projects as assigned such as personal events and/or family needs- which may include coordinating house... 

Adventist Health

Billing Follow Up Associate, Home Health, Full Time, Day Shift-8Hr Job at Adventist Health

 ...information for claim appeals. Completes billing and collection processes and prepares for...  ...education/related experience: Preferred Medical billing and collections experience:...  ...including 26 acute care facilities, clinics, home care, and hospice agencies in both rural...