Databricks Technical Lead

Come join us

The Databricks Technical Lead is a senior, hands-on role responsible for the design, development, and delivery of highly scalable, secure, and performant data solutions on the **Databricks Lakehouse Platform**. It is expected to provide technical leadership to a team of engineers, defining coding standards, implementing architectural patterns, and ensuring the delivery of high-quality data products.

Skills and experiences

**Required Skills & Experience**:

- Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
- **8+**years**of progressive experience in Data Engineering, with **[4]+ years**focused on large-scale data processing using **Databricks and Apache Spark**.
- Expert proficiency in **Python (PySpark)**and advanced **SQL**.
- Deep expertise in implementing **Lakehouse architecture**using **Delta Lake**and familiarity with the **Medallion Architecture**(Bronze, Silver, Gold).
- Strong experience with data modeling techniques (e.g., dimensional modeling, data vault) suitable for large data volumes.
- Proven experience leading technical teams, including defining tasks, performing code reviews, and providing architectural guidance.
- Hands-on experience implementing **DataOps/DevOps**practices and CI/CD pipelines for data solutions (e.g., Terraform, Databricks Asset Bundles, Git).

**Preferred Skills & Certifications**:

- Experience with Databricks features like **Delta Live Tables (DLT), Databricks Workflows, and Unity Catalog**.
- Experience with streaming technologies (e.g., Kafka, Spark Streaming).
- Familiarity with CI/CD tools and Infrastructure-as-Code (e.g., Terraform, Databricks Asset Bundles).
- **Databricks Certified Data Engineer Associate**or **Professional**certification

About you

Characteristics that can spell success for this role
- Consultative, collaborative, curious
- Resilient, adaptable, flexible
- Humble leader, strong negotiator, relationship builder
- Passionate about tech and engaging with and advising clients

What you'll do
- **Lead the Design**:Define and implement robust data architectures utilizing the Databricks ecosystem, including **Delta Lake, Unity Catalog, Delta Live Tables (DLT), and Databricks Workflows**.
- **Hands-on Development**:Serve as the most senior developer, writing high-quality, production-grade code in **PySpark/Scala and SQL**for complex batch and streaming ETL/ELT pipelines.
- **Performance Optimization**:Lead performance tuning and optimization efforts for large-scale Spark jobs, ensuring efficient cluster utilization and cost management.
- **Standards & Best Practices**:Define and enforce technical standards, code quality, testing frameworks (unit, integration), and DataOps/CI/CD pipelines for the engineering team.

Enjoy your career

Some of the best things about working at Avanade- Opportunity to work for Microsoft’s Global Alliance Partner of the Year, with exceptional development and training (minimum 80 hours per year for training and paid certifications)
- Real-time access to technical and skilled resources globally
- Dedicated career advisor to encourage your growthEngaged and helpful coworkers genuinely interested in youFind out more about some of our benefits
Employee Benefits at Avanade | Avanade

A great place to work
- As you bring your skills and abilities to Avanade, you’ll get distinctive experiences, limitless learning, and ambitious growth in return. As we continue to build our diverse and inclusive culture, we become even more innovative and creative, helping us better serve our clients and communities. You’ll join a community of smart, supportive collaborators to lift, mentor, and guide you, and to lean on your expertise. You get a company purpose-built for business-critical, leading-edge technology solutions, committed to improving the way humans work, interact, and live. It’s all here, so take a closer look
- We work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees. Visit our Inclusion & Diversity page.
- Create a future for our people that focuses on
- Expanding your thinking - Experimenting courageously - Learning and pivoting
- Inspire greatness in our people by
- Empowering every voice - Encouraging boldness - Celebrating progress
- Accelerate the impact of our people by
- Amazing the client - Prioritizing what matters - Acting as one