Note: The job is a remote job and is open to candidates in USA. MediaRadar, Inc. is seeking a highly technical, hands-on Senior Data Engineer to drive the evolution of their data delivery platform while leading a team of data engineers. This role involves architecting the next-generation data stack, building proofs-of-concept, and managing a distributed team to ensure high-quality data delivery.
Responsibilities
- Lead, manage, and grow a distributed team of data engineers (across North America and India) who report directly to you
- Champion the use of AI coding assistants (e.g., GitHub Copilot, Cursor, Claude) and prompt-based development to accelerate prototyping, code generation, refactoring, testing, and documentation. Establish best practices, guardrails, and review standards so the team uses these tools effectively and safely
- Personally build proofs-of-concept to validate new tools and patterns (e.g., ClickHouse, dbt, open-source orchestration and pipeline frameworks) before broader rollout, and translate the results into clear recommendations
- Help shape the technical vision for our ETL and data platform. Evaluate, prototype, and recommend the technologies that will carry us forward, balancing flexibility, cost, performance, and avoiding vendor lock-in
- Drive the hands-on migration away from Azure Databricks toward a more open, flexible stack, minimizing disruption to our high-volume daily data delivery
- Design, build, and optimize robust ETL pipelines that move and transform millions of daily data points reliably and efficiently
- Master all systems upstream and downstream of your area, from ingestion through to client-facing platforms, to ensure seamless, high-quality, end-to-end data delivery
- Establish testing frameworks, QA plans, observability, and CI/CD practices that guarantee data integrity at scale
- Set technical standards and raise the bar across a distributed team (North America and India) through design guidance, code reviews, and mentorship — leading by expertise rather than direct people management
- Rapidly learn the nuances of the Advertising and Market Research domain to translate business needs into robust technical requirements
Skills
- 8+ years in data engineering / ETL, with a strong track record as a hands-on engineer who has architected and built data platforms (Principal-level candidates will bring deeper architectural and cross-team impact)
- Hands-on experience using AI coding tools (e.g., GitHub Copilot, Cursor, Claude, or similar) and strong prompt-based development skills, with good judgment about where these tools help and where human review is essential
- Expert-level SQL and RDBMS skills with deep, hands-on experience in SQL Server and Postgres (schema design, performance tuning, complex query optimization, root-cause analysis)
- Hands-on experience with technologies such as ClickHouse, dbt, and open-source data pipeline / orchestration tools (e.g., Airflow, Dagster, or similar), with the judgment to choose the right tool for the job
- Strong, hands-on AWS experience is required, as we are standardizing on AWS as we move off Azure Databricks
- Demonstrated ability to independently prototype, benchmark, and evaluate new technologies and make pragmatic adoption decisions
- Strong proficiency in Python (or similar) for building and automating data pipelines
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field
- Previous experience in Advertising, Media, or Market Research
- Familiarity with containerization (Docker, Kubernetes) and infrastructure-as-code
- Experience with streaming/real-time data technologies (e.g., Kafka)
Benefits
- Medical, Dental & Vision Insurance
- 401k with Company Match
- Flexible PTO
- Commuter Benefits
- Gym Discounts
- Summer Fridays
Company Overview
Company H1B Sponsorship