jobapplier

Resident Solution Architect

Weekday

This role is for one of our clients

Industry: Technology, Information and Internet

We are looking for an experienced Resident Solutions Architect with strong expertise in Databricks, Apache Spark, Data Engineering and Cloud Data Platforms.

The RSA will work closely with enterprise customers to understand complex data and AI requirements, design scalable architectures, lead technical engagements and help customers successfully implement and productionize solutions on the Databricks platform.

The ideal candidate combines strong hands-on technical expertise with excellent customer-facing, consulting and communication skills.

Responsibilities

  • Work directly with enterprise customers as a trusted technical advisor.
  • Understand customer business and technical requirements and translate them into scalable data architectures.
  • Design and implement modern Lakehouse / Data + AI architectures using Databricks.
  • Develop and guide POCs, technical workshops and architecture demonstrations.
  • Work extensively with Apache Spark / PySpark, SQL and Databricks.
  • Design scalable data ingestion, transformation and processing pipelines.
  • Work with Delta Lake, Unity Catalog and Databricks platform capabilities.
  • Support data migration and modernization initiatives.
  • Integrate Databricks with cloud platforms such as AWS, Azure or GCP.
  • Troubleshoot performance, scalability, reliability and data pipeline issues.
  • Work with customer engineering, data science, architecture and leadership teams.
  • Provide technical recommendations around data engineering, analytics, ML/AI and cloud architecture.
  • Create reference architectures, technical documentation and implementation guidance.
  • Support production deployment and adoption of Databricks solutions.
  • Conduct technical workshops, enablement sessions and knowledge-sharing activities.

Requirements

  • Min Experience: 9+ years
  • Strong experience with Databricks
  • Strong Apache Spark / PySpark
  • Strong SQL
  • Strong Data Engineering fundamentals
  • Experience designing data pipelines / data platforms
  • Experience with Lakehouse / Data Warehouse / Big Data architecture
  • Azure
  • Strong customer-facing / consulting experience
  • Excellent communication and presentation skills
  • Hadoop ecosystem
  • Databricks' own Solutions Architect requirements similarly emphasize customer-facing architecture, big-data/data-science expertise, SQL, programming, cloud and the ability to translate customer needs into technical solutions.
  • Data Engineering, Python, Solution Architecture

Preferred

  • Delta Lake
  • Unity Catalog
  • MLflow
  • Kafka
  • Streaming
  • Data migration
  • MLOps
  • Machine Learning
  • GenAI
  • Data governance
  • SQL, azure, Databricks