3M logo

Lead Data Engineer

3M
NewPosted yesterday

LOCATION

Minnesota · Onsite

EXPERIENCE

7+ Years

TYPE

FullTime

SALARY

$188.25K - $230.08K /year

SKILLS REQUIRED

Data EngineeringData PipelinesTechnical LeadershipPythonSQLSparkDatabricksData Governance

Job description

Overview

Lead Data Engineer role focused on designing, developing, and optimizing scalable data platforms that power AI/ML and advanced analytics applications.

What you'll do

  • Lead the architecture and development of scalable, secure data pipelines supporting AI/ML workloads.
  • Own end to end data engineering processes: ingestion, transformation, storage, quality, and monitoring.
  • Collaborate with data scientists and ML engineers on model features, training pipelines, and deployment.
  • Drive best practices in data modeling, orchestration, versioning, and performance optimization.
  • Mentor and guide junior engineers; contribute to technical roadmaps and solution patterns.
  • Ensure data governance, lineage, and compliance standards are met across platforms.
  • Support real time and batch processing frameworks in production environments.

What you'll need

  • Bachelor's degree or higher in computer science (completed and verified prior to start).
  • Seven (7) years of data engineering experience, including leading technical initiatives in a private, public, government or military environment.

Nice to have

  • Strong expertise in Python, SQL, and distributed data systems (e.g., Spark, Databricks, Synapse).
  • Experience building AI/ML ready data pipelines, including feature stores and model training data flows.
  • Hands on experience with cloud platforms (Azure preferred — Data Lake, Data Factory, Databricks, Cosmos DB).
  • Strong understanding of ML concepts, lifecycle, and MLOps practices.
  • Proven experience with workflow orchestration (Airflow, Data Factory, Synapse Pipelines, etc.).
  • Strong communication and ability to translate business needs into technical solutions.
  • Experience with streaming platforms (Kafka, Event Hub).
  • Familiarity with vector databases, embeddings, or LLM oriented data pipelines.
  • Background in DevOps, CI/CD, or infrastructure as code.
  • Experience designing data solutions for AI applications or intelligent platforms.

Details

  • Work location: Remote in the US.
  • Travel: May include up to 5% primarily domestic travel.
  • Relocation: Not authorized.
  • Must be legally authorized to work in country of employment without sponsorship for employment visa status (e.g., H1B status).
  • Full time position.

Read the full description and apply on the company’s own careers page.

Stay safe

Hiring on Abekus is free for applicants

We never charge a fee, and employers are prohibited from doing so. If a recruiter asks for payment, please report them right away.

Lead Data Engineer