Senior Data Engineer - Azure, Databricks & ML Pipelines | Remote（远程职位）

这条招聘信息来自 Toptal，岗位是 Senior Data Engineer - Azure, Databricks & ML Pipelines | Remote：这是高级职位，公司期待由你自己拿主意。职位属于「数据与分析」类别，完全远程。公司不限制候选人的居住地，在任何地方都可以申请。

招聘信息里列出的主要工具是：Python、SQL、Machine Learning。简历上最好能给出正是这几项能力的具体例子。

公司没有公布具体数字，这一项会在面试时谈定。对工作时间，招聘信息没有提出任何条件。

这个职位通过了自动核查：凡是要求外国工作许可、签证担保、特定国籍，或者必须居住在指定国家的招聘信息，都不会进入列表。

Headquarters: Remote

URL: https://www.toptal.com/

About the Role

We're looking for a Senior Data Engineer to design, build, and maintain scalable data pipelines and ML-ready infrastructure on Azure and Databricks. This is a hands-on engineering role: you'll own the full data pipeline lifecycle - ingestion, transformation, orchestration, and deployment - while supporting machine learning workflows with clean, reliable data. If you're comfortable owning infrastructure decisions and writing production-quality Python at scale, this role is built for that.

What You'll Do

* Design, build, and maintain data pipelines using Databricks and Azure-native data services

* Develop and optimize ETL/ELT processes to support analytics and machine learning workloads

* Build and maintain CI/CD pipelines for data engineering and ML deployment workflows

* Write clean, efficient, production-quality Python for data processing and pipeline automation

* Support machine learning teams with well-structured, high-quality datasets and feature pipelines

* Design and manage data architecture across Azure services (e.g., Azure Data Factory, Azure Data Lake, Azure Synapse)

* Monitor pipeline performance, troubleshoot data quality issues, and implement reliability improvements

* Implement data governance, security, and access control best practices

* Collaborate with data scientists, analysts, and software engineers to align data infrastructure with business needs

* Participate in code reviews, architecture discussions, and technical planning

What You Bring

* Strong hands-on experience with Azure cloud data services

* Proven experience building and maintaining pipelines on Databricks

* Solid experience designing and managing CI/CD pipelines for data or ML workflows

* Strong Python skills for data engineering and pipeline development

* Working knowledge of machine learning workflows and how data engineering supports them

* Experience with SQL and relational/distributed data systems

* Understanding of data pipeline orchestration, monitoring, and reliability practices

* Strong problem-solving skills and ability to work independently on complex data infrastructure challenges

* Solid communication skills for collaborating with data science and engineering teams

Nice to Have

* Experience with MLOps practices and tools (MLflow, Azure ML)

* Familiarity with Spark internals and performance tuning within Databricks

* Experience with infrastructure-as-code (Terraform, Bicep, ARM templates)

* Exposure to real-time/streaming data pipelines (Kafka, Event Hubs, Structured Streaming)

* Relevant Azure or Databricks certifications

Why This Role

* Full pipeline ownership: Own data infrastructure end to end, from ingestion through ML-ready delivery

* Modern data stack: Work with Azure and Databricks, leading platforms in enterprise data engineering

* Cross-functional impact: Directly enable machine learning and analytics outcomes, not just move data

* Flexibility: Remote-friendly engagement structure

How to Apply

Ready to bring your data engineering expertise to Azure and Databricks-powered ML infrastructure? Apply through Toptal here: https://www.toptal.com/talent/apply

 

To apply: https://weworkremotely.com/remote-jobs/toptal-senior-data-engineer-azure-databricks-ml-pipelines-remote