Senior Data Engineer

About Brainchild

At Brainchild, we are building the operational, data-driven layer for marketing. Our flagship AI product, Logos, bridges the gap between raw data and live advertising campaigns, with complete automation.

We are currently making waves in the music and entertainment industry, empowering powerhouse management teams and legendary bands like Electric Callboy and Lamb of God to scale their global reach using data. If you want to design and own the data pipelines that power automated marketing for global music icons, you're in the right place.

The Role

As a Senior Data Engineer, you will be the custodian of our data ecosystem. You will architect, scale, and nurture our core Databricks pipelines and take ownership of ingesting massive volumes of data from a multitude of disparate external sources (streaming platforms, ad networks, social media, ticketing platforms)—mostly through complex, API-first integrations.

Key Responsibilities

• Pipeline Architecture: Design, build, and optimize robust, scalable ETL/ELT pipelines within Databricks (using Delta Lake, PySpark, or SQL).
• API Integration & Ingestion: Architect resilient data ingestion frameworks to harvest, clean, and standardize data from disparate third-party APIs.
• Data Modeling: Nurture our core data models to support advanced, AI-driven marketing analytics and real-time campaign triggering.
• Performance Tuning: Proactively monitor, optimize, and debug Databricks cluster performance and query runtimes to keep infrastructure efficient.
• Technical Leadership: Set the standard for data quality, testing frameworks, and documentation; mentor junior team members and collaborate closely with DevOps and Product teams.

What We Are Looking For

You are a seasoned data professional who thrives on turning messy, fragmented data streams into elegant, unified data layers. You know APIs inside and out and understand how to build for reliability at scale.

Required Skills & Qualifications

• Experience: 5+ years of dedicated data engineering experience, preferably in fast-paced startup or cloud-native environments.
• Databricks Mastery: Deep hands-on experience with Databricks, Spark (PySpark/Scala), and building modern data lakehouse architectures.
• API Expertise: Proven track record of building robust ingestion pipelines pulling data from diverse, rate-limited, or complex REST/GraphQL APIs.
• Cloud & DevOps Ecosystem: Familiarity with AWS services and how data infrastructure interacts with IaC (Terraform) and containerization.
• Engineering Standards: Strong software engineering fundamentals (clean code, version control, testing pipelines, CI/CD for data).

What We Offer

• High Impact & Ownership: You are the architect of our data foundation. Your pipelines directly influence how marketing dollars are spent for global artists.
• Steep Learning Curve: Work alongside cutting-edge AI product engineers in a highly modern, serverless, and API-first environment.
• Industry Insights: A unique look under the hood of both the digital advertising ecosystem and the global music industry.
• Flexibility: A central city-center office, paired with a mature remote-first work culture and flexible hours.
• Compensation: Highly competitive senior-level pay and benefits.