Staff Data Engineer (Python, LLM, Data Platforms) - Remote

Staff Data Engineer (Python, LLM, Data Platforms) – Remote Remote (U.S. Only) $220,000 – $240,000 + Full Benefits About the Opportunity An international media and digital analytics organization is seeking a Staff Data Engineer (formally titled Staff Engineer – Data Engineering) to lead the evolution of its large-scale data platforms. This is a senior, high-impact individual contributor role focused on data architecture, cross-platform integration, and building LLM-powered data products. You’ll work across multiple systems and teams to define long-term architecture and ensure platforms scale reliably in a complex environment. This is a data engineering and platform architecture role—not an ML model development position. Experience in streaming platforms (e.g., Spotify, Netflix, Hulu) or B2B SaaS environments is strongly preferred.

Key Responsibilities

• Design and own scalable, cross-platform data architecture across complex systems
• Lead integration of data platforms to enable unified insights and product capabilities
• Build and optimize large-scale data pipelines (batch and streaming) and data models using Python and modern frameworks
• Develop production-grade Python code for data processing, platform services, and LLM-enabled workflows
• Design and deliver LLM-powered applications and data products
• Establish best practices for data modeling, pipeline design, and system observability
• Mentor engineers and raise the technical bar across teams
• Translate business needs into clear, scalable architectural decisions
• Contribute to architecture reviews, roadmap planning, and on-call support

Required Qualifications

• 8+ years of experience in data engineering or data architecture
• Proven experience working in complex, multi-system or multi-team environments
• Strong Python expertise (5+ years of hands-on, production-level development)
• Experience building LLM-powered systems or data-driven AI applications in production
• Deep experience with large-scale data architecture (pipelines, modeling, warehousing)
• Strong communication skills — able to clearly articulate architectural decisions
• Demonstrated success mentoring engineers and elevating team performance

Strongly Preferred

• Experience in streaming platforms or B2B SaaS environments
• Experience with Snowflake, BigQuery, or similar cloud data warehouses
• Familiarity with Kafka or real-time streaming architecture
• Experience with Kubernetes or containerized environments
• Track record of cross-platform or cross-division data integration
• Passion for mentorship, teaching, and building engineering culture

Technical Environment

• Cloud data warehouses (Snowflake, BigQuery, or similar)
• Data processing & orchestration (Spark, Airflow)
• Streaming platforms (Kafka or equivalent)
• Batch and real-time data pipelines
• Cloud-native / containerized environments (Kubernetes a plus)

What Success Looks Like

• First 90 days: Deliver an architectural assessment and identify integration opportunities
• 6 months: Lead a cross-platform data or LLM-driven initiative
• 12 months: Own the data architecture roadmap and mentor multiple engineers

Benefits

• Medical, Dental, and Vision coverage
• 401(k) with company match
• Generous paid parental leave
• Flexible work schedule + unlimited PTO
• Monthly stipends (home office, internet, wellness)
• Annual company event
• Collaborative culture with strong work-life balance

Remote Skills: Architectural Analysis, Architectural Services, Artificial Intelligence (AI), Best Practices, Business-to-Business (B2B), Cloud Computing, Communication Skills, Data Management, Data Modeling, Data Processing, Data Warehousing, Mentoring, Multiplatform/Cross-Platform, On Call, Python Programming/Scripting Language, Snowflake Schema, Software Engineering, Software as a Service (SaaS), Team Player, Warehousing About the Company: Search Partner Group