Databricks Architect - R01573990
- San Francisco, United States
- Hybrid
- Full-time
- Lead/Staff
- Posted
Data Architect
Responsibilities
- Design and architect scalable, high-performance data solutions utilizing Databricks and leading cloud data platforms
- Develop, optimize, and maintain ETL pipelines with SQL, Python, and Databricks to ensure efficient data ingestion, transformation, and loading
- Implement robust data models and data warehousing solutions to drive analytics, reporting, and business intelligence outcomes
- Automate and streamline data workflows to enhance system efficiency and minimize processing times
- Monitor, troubleshoot, and resolve performance bottlenecks in data pipelines and platform components
- Ensure data quality, consistency, and security across all data assets and platforms
- Collaborate with cross-functional teams to translate business requirements into technical data architecture solutions
- Document architecture designs, data flows, and best practices to support operational excellence and knowledge sharing
Requirements
- ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data Warehousing, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures
- Specialization
- Databricks Engineering: Data Architect
Looking for candidate local to CA
- Full-time role, does not open for a sponsorship.
- Experience Range: With at least 7 years of experience in data architecture and engineering, including substantial hands-on expertise with Databricks and modern data platforms
- Advanced proficiency with Databricks platform and ecosystem
- Expertise in designing and developing ETL pipelines using SQL and Python
- Expert-level SQL, including advanced query optimization
- Proficiency in Python for data engineering and automation
- Comprehensive knowledge of data warehousing concepts and design patterns
- Experience with data modeling techniques and best practices
Hands-on experience with PLSQL and T-SQL
- Ability to develop and maintain stored procedures for data transformation
- Experience with performance tuning and troubleshooting in distributed data environments
Preferred
- Experience with Azure Data Lake, AWS S3, or Google BigQuery
- Familiarity with Delta Lake and lakehouse architecture concepts
- Knowledge of CI/CD practices for data engineering pipelines
- Working experience with Scala or Java in data engineering contexts
Exposure to data governance, cataloging, and lineage tools
- Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a closely related discipline
- Databricks Certified Data Engineer Associate or Professional certification
- Certification in cloud data platforms such as Microsoft Azure Data Engineer Associate, AWS Certified Data Analytics, or Google Professional Data Engineer
