First Monday
Jobs
Jobs open to youOnly jobs that can hire where you liveA CV for each jobWritten from your record, every line checkedMemoryIt remembers, so you don’t repeat yourselfInterview helpResearch, prep and hints only you seeWatch how it works0:28
FAQDocsUse in AI, Free
Your countryNorth AmericaEuropeAsia-PacificLatin AmericaNot on the list? Tell us where you liveRequest early accessEarly access
First Monday

Remote jobs that can actually hire you.

Beta formacOSWindows

Jobs

Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico

Product

Jobs open to youA CV for each jobMemoryInterview helpHow it works

Company

FAQContact

Legal

Privacy PolicyTerms & Conditions
Jobs
Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico
Product
Jobs open to youA CV for each jobMemoryInterview helpHow it works
Company
FAQContact
Legal
Privacy PolicyTerms & Conditions
Remote jobs by country
United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand

Remote jobs by country

United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand
© 2026 First MondayNo tracking cookies. Anonymous page statistics only.
First Monday
Jobs/Data and AI/Lead Data Engineer
B

Lead Data Engineer

Black Canyon Consulting

Bethesda, MDData and AIPosted September 25, 2026
Probably open to people in the United StatesApply for this job Write my CV for this job Early access
Pay
Not stated
Required
DuckDB, Apache Iceberg, SQL, Python, Amazon S3, AWS Glue, LangChain, LangGraph
Nice to have
Kafka, Amazon MSK, U.S. Federal Government
Experience
6+ years
Benefits
Health insurance, Dental and vision, Retirement plan, Paid time off
Posted
September 25, 2026
Company
Black Canyon Consulting

Who it can hire

We read the post for each of the 21 countries we cover.

  • Probably open to people in the US · Location only

    The listing’s location: “Bethesda, MD”.

  • Not open to people in the other 20 countries we cover, as far as the post says.

The job post

Overview

We are seeking a Lead Data Engineer to design and implement the core analytical data platform for a federal permitting modernization initiative.

The Lead Data Engineer will establish a modern lakehouse environment using DuckDB, Apache Iceberg, Amazon S3, and AWS Glue Catalog and will lead the engineering patterns used to ingest, harmonize, and serve data across multiple source systems. The role will also help implement metadata-driven and agentic approaches to data engineering, including source analysis, mapping, pipeline generation, testing, reconciliation, and quality assurance.

This is a hands-on technical leadership role with responsibility for guiding and reviewing the work of other Data Engineers.

This position is remote.

Duties & Responsibilities

  • Design and implement the core DuckDB / Apache Iceberg data platform on AWS.
  • Define physical data organization, schema, partitioning, file layout, snapshot, compaction, and optimization strategies for Iceberg tables.
  • Integrate DuckDB with Amazon S3, Apache Iceberg, and AWS Glue Catalog.
  • Establish bronze, silver, and gold data-layer conventions and reusable engineering patterns.
  • Lead and mentor Data Engineers, providing technical direction, code reviews, and engineering guidance.
  • Build and maintain analytical datasets supporting application services, reporting, analytics, and data science.
  • Develop reusable patterns for incremental loads, CDC, schema evolution, late-arriving data, backfills, and historical reconstruction.
  • Work with the Data Architect to implement the common canonical data model and source-to-canonical mappings.
  • Lead migration and harmonization of datasets from multiple source systems.
  • Implement reconciliation processes that demonstrate completeness and accuracy between source and target systems.
  • Establish automated data-quality monitoring, operational observability, and testing.
  • Implement agentic and AI-enabled data engineering patterns supporting activities such as source analysis, mapping, pipeline generation, troubleshooting, reconciliation, and quality assurance.
  • Support integration of structured data with associated document and geospatial datasets.
  • Lead development of certified data products, analytical datasets, and business metrics.
  • Optimize DuckDB queries and Iceberg datasets for performance and efficiency.
  • Develop engineering documentation, operational procedures, and technical handoff materials.

Educational Requirements

  • Bachelor's degree in Computer Science, Data Engineering, Information Systems, Engineering, or a related field.

Requirements

  • 6+ years of relevant data engineering or data platform experience, including experience leading or mentoring other engineers.
  • Strong hands-on experience with DuckDB and Apache Iceberg.
  • Advanced SQL and strong Python development experience.
  • Experience building cloud-based analytical platforms using object storage and columnar formats such as Parquet.
  • Strong understanding of partitioning, schema evolution, snapshots, compaction, incremental processing, and analytical query optimization.
  • Experience implementing bronze/silver/gold or comparable layered data architectures and transforming heterogeneous enterprise datasets.
  • Experience with AWS data services, particularly Amazon S3 and AWS Glue.
  • Experience designing reusable, metadata-driven ingestion and transformation frameworks.
  • Experience implementing automated data quality, reconciliation, monitoring, and operational controls.
  • Experience with agentic or AI-enabled data engineering solutions, including the use of agents or AI-assisted workflows for activities such as data mapping, pipeline generation, validation, testing, or troubleshooting.
  • Hands-on experience with agentic frameworks such as LangChain, LangGraph, or similar frameworks for building tool-using or multi-step AI workflows.
  • Strong troubleshooting, performance tuning, and technical leadership skills.

Bonus Skills

  • Experience with Kafka or Amazon MSK and CDC architectures.
  • Experience with GeoParquet, PostGIS, or geospatial datasets.
  • Experience with OpenSearch, document stores, or vector search technologies.
  • Experience integrating enterprise SaaS platforms, APIs, databases, and file-based sources.
  • Experience working in the U.S. Federal Government space.

Experience with permitting, regulatory, land management, environmental, energy, or natural-resource datasets.

Benefits and Salary

We attract the best people in the business with our competitive benefits package that includes medical, dental and vision coverage, 401k plan with employer contribution, paid holidays, vacation, and tuition reimbursement.

If you enjoy being a part of a high performing, professional service and technology focused organization, please apply today!

First Monday isn’t the employer or a recruiter and isn’t affiliated with Black Canyon Consulting. Details may have changed since; confirm with the employer before you apply.

Probably open to people in the United StatesApply for this job Write my CV for this job Early access
Pay
Not stated
Required
DuckDB, Apache Iceberg, SQL, Python, Amazon S3, AWS Glue, LangChain, LangGraph
Nice to have
Kafka, Amazon MSK, U.S. Federal Government
Experience
6+ years
Benefits
Health insurance, Dental and vision, Retirement plan, Paid time off
Posted
September 25, 2026
Company
Black Canyon Consulting

Similar jobs open to people in the United States

🇺🇸 Data Engineer, Remote – Full TimeXperteez Technology · Remote · USSenior Data EngineerReady · USSenior Data EngineerNimble Gravity · Remote · USPrincipal Data EngineerConstant Contact · Remote · US, Canada (Ontario)
First Monday

Get jobs like this every Monday.

One email a week with new remote jobs open to people in Canada. Free, and one click to unsubscribe. Privacy Policy

Or request early access to the app
Apply for this job