Note: The job is a remote job and is open to candidates in USA. Agile Resources, Inc. is partnering with an industry leader in the construction supplies and equipment space to find a Sr. Data Engineer to spearhead the evolution of their global, next-generation data ecosystem. In this role, you will act as the architect behind a mission-critical platform, transforming raw datasets into powerful, secure, and production-ready intelligence that fuels executive-level decisions.
Responsibilities
- Architect and optimize high-throughput, distributed computing frameworks and modern Lakehouse structures to handle massive data velocity and volume
- Construct robust, production-grade features and pipelines that seamlessly operationalize large language models (LLMs) and predictive machine learning models
- Build automated ingestion frameworks across multi-cloud environments, utilizing both real-time streaming and scheduled batch processing
- Establish solid data quality, unified cataloging, and access controls while aggressively optimizing cluster performance and cloud infrastructure costs
- Collaborate with cross-functional leadership, finance, and operations teams to convert complex strategic goals into highly scalable technical solutions
Skills
- Applicants must be legally authorized to work in the United States on a full-time basis
- 7+ years of sophisticated data engineering experience, highlighted by mastery-level knowledge of Spark tuning, partitioning, and cloud infrastructure
- Extensive hands-on experience designing secure, ACID-compliant storage layers, ideally utilizing modern unified cataloging tools
- Expertise in Python and SQL, coupled with practical experience supporting ML lifecycle management (such as tracking, feature stores, or LLM integrations)
- A proven track record of integrating disparate, complex data sources and maintaining high-availability production environments at enterprise-scale
- Familiarity with event-driven architectures (like Kafka)
- Continuous integration/continuous deployment (CI/CD) pipelines
- Infrastructure-as-code
Benefits
- Medical
- Dental
- Vision
Company Overview