Databricks Enterprise Lead Security Architect - Principal IT Software Engineer (San Francisco) Job at Databricks Inc., San Francisco, CA

UDRNR2VsM3QzSGpvWHE0cFJrZkJDWHhHZ3c9PQ==
  • Databricks Inc.
  • San Francisco, CA

Job Description

We are looking for a highly skilled, technology and business-savvy Lead Security Architect to join our team within Databricks IT. In this dynamic, fast-paced environment, you will be responsible for designing and implementing a secure and scalable architecture to protect our corporate assets. You'll focus on key areas of IT security, including Identity and Access Management, Zero Trust architecture, and endpoint security, while also working to secure critical business applications and sensitive data. Your expertise will be crucial in building proactive security strategies that align with our business goals and protect the company from an ever-evolving threat landscape.

This position demands deep expertise in security principles and a comprehensive understanding of the entire infrastructure stack and IAM systems to design robust, future-ready security solutions. You will be instrumental in safeguarding our systems' resilience and integrity against ever-evolving cyber threats.

You will play a critical role in shaping our security strategy for modern platforms across AWS, Azure, GCP, network infrastructure, storage, and SaaS solutions, help establish a strong least privilege (PoLP) model, providing specialized IAM expertise, and securely supporting SaaS with sensitive information (NHI). You will also be a key contributor in building our internal strategy for secure AI development.

Additionally, you will support the secure integration of SaaS platforms such as Google Workspace, collaboration tools, and GTM systems, maintaining alignment with enterprise security standards. Close collaboration with cross-functional teams is essential to embed security throughout the technology stack.

The impact you will have:

What You Will Do:

Design and implement secure, scalable reference architectures for the Databricks IT across Cloud Infra (Compute, DBs, Network, Storage), SaaS, Custom Built Applications, Data & AI systems.

Identity and Access Management (IAM):

SSO, SCIM user provisioning, RBAC via Un, Strong MFA best practices for enterprise identities and customers.

Core Security Areas:

  • Databricks Workspace Management: Workspace isolation, Unity Catalog for data governance.
  • Secure Networking: VPC configs, PrivateLink, IP Allow Lists.
  • Data Encryption: At rest and in transit, customer-managed keys for critical assets.
  • Data Exfiltration Prevention: Admin console settings, VPC endpoint controls.
  • Cluster Security: User isolation, compliance with enhanced security monitoring/Compliance Security Profiles (HIPAA, PCI-DSS, FedRAMP).
  • Offensive Security: Test and challenge the effectiveness of the organizations security defenses by mimicking the tactics, techniques, and procedures used by actual attackers.

Specialized Security Functions:

  • Non-human Identity Management: Design and implement secure authentication and authorization for automated systems (service accounts, API keys, machine identities), focusing on automation and integration with existing identity management systems.
  • IAM Best Practices: Develop and document comprehensive Identity and Access Management policies, including user provisioning, de-provisioning, access reviews, privileged access management, and multi-factor authentication, ensuring security and compliance.
  • Data Loss Prevention (DLP): Implement DLP solutions to identify, monitor, and protect sensitive data across endpoints, networks, and cloud environments, preventing unauthorized access, use, or transmission.
  • SaaS Proxy Design and Implementation: Design and implement cloud-based proxies for SaaS applications (SASE solutions) to provide secure access, enforce security policies, monitor user activity, and protect against threats.
  • Cloud Infrastructure Best Practices: Establish and document best practices for VPC configurations, cloud networking, and infrastructure as code using Terraform, ensuring secure network segmentation, routing, firewalls, and VPNs for consistent, automated, and secure deployments.
  • Least Privilege Access for Data Security: Design and implement data security controls based on the principle of least privilege, ensuring users and systems have only the minimum necessary access through fine-grained controls, data classification, and regular access reviews.
  • Guide internal IT on Databricks security and compliance certifications (SOC 2, ISO 27001/27017/27018, HIPAA, PCI-DSS, FedRAMP), and support security reviews/audits.
  • Support incident response, vulnerability management, threat modeling, and red teaming using audit logs, cluster policies, and enhanced monitoring.
  • Stay current on industry trends and emerging threats in GenAI, AI Agentic flow, MCPs to enhance security posture.
  • Advise executive leadership on security architecture, risks, and mitigation.
  • Mentor security engineers and developers on secure design and best practices.

What we look for:

  • Bachelors degree in Computer Science, Information Security, Engineering, or a related field
  • Masters degree in Computer Science specifically in Information Security or a related discipline is strongly preferred
  • Minimum 12 years in cybersecurity, with 5+ in security architecture or senior technical roles.
  • Experience in FedRAMP High systems/ GovCloud preferred.
  • Must have direct experience designing and securing enterprise platforms in complex multi-cloud environments, deep knowledge of enterprise architecture and security features (control plane/data plane separation, network infra, workspace hardening, network segmentation/ isolation), and hands-on experience automating security controls with Terraform and scripting.
  • Proven expertise securing data analytics pipelines, SaaS integrations, and workload isolation in enterprise ecosystems.
  • Experience with Enterprise Security Analysis Tools and monitoring/security policy optimization.
  • Deep experience in threat modeling, design, PoC, and implementing large-scale enterprise solutions.
  • Extensive hands-on experience in AWS cloud security, network security, with knowledge of Zero Trust, Data Protection, and Appsec.
  • Strong understanding of enterprise IAM systems (Okta, SailPoint, VDI, Entra ID) and Data Protection.
  • Expert experience with SIEM platforms, XDR, and cloud-native threat detection tools.
  • Expert in web application security, OWASP, API security, and secure design and testing.
  • Hands-on experience with security automation is required, with proficiency in AI-assisted development, Python, Cursor, Lambda, Terraform, or comparable scripting/IaC tools for operational efficiency.
  • Industry certifications like CISSP, CCSP, CEH, AWS Certified Security Specialty, AWS Certified Solutions Architect Professional, or AWS Certified Advanced Networking Specialty (or equivalent) are preferred.
  • Ability to influence stakeholders and drive alignment.
  • Strategic thinker with a passion for security innovation, continuous improvement, and building scalable defenses.

Pay Range Transparency

Zone 1 Pay Range

$258,300 $361,575 USD

About Databricks

Databricks is the data and AI company. More than 10,000 organizations worldwide including Comcast, Cond Nast, Grammarly, and over 50% of the Fortune 500 rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. To learn more, follow Databricks on Twitter ,LinkedIn and Facebook.

Benefits

At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visit

Our Commitment to Diversity and Inclusion

At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.

Compliance

If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.

#J-18808-Ljbffr

Job Tags

Full time, Worldwide,

Similar Jobs

The Staff Pad

Certified Medical Coder Job at The Staff Pad

 ...Staff Pad has partnered with a hospital in Helena, Montana to find an experienced Medical Coder The Medical Coder is responsible for accurately assigning ICD-9-CM and CPT codes to hospital records, clinic visits, lab, and imaging tickets, ensuring compliance... 

Infante Real Estate

Admin Assistant / Social Media Manager Job at Infante Real Estate

 ...and my team with various operational duties. Assistant will also be responsible for making creative short videos, growing social media accounts, and posting daily. Qualifications Administrative skills, including scheduling, filing, and responding to inquiries... 

Horizon Air

Ground/Ramp Service Agent Job at Horizon Air

Company: Horizon Air The Team: Our airport teams work together to move guests and their belongings from curb to cabin, creating remarkable...  ...mathematics. Ability to work a flexible schedule including nights, weekends and holidays. Ability to participate in paid... 

EIG Electrical Systems

Low Voltage Technician Job at EIG Electrical Systems

 ...Job Description Job Description Evergreen Innovation Group, part of the DPR Family of Companies, is seeking a Low Voltage Technician to join our team in Richmond, VA. Low Voltage Technicians are responsible for installing cables and wires correctly to ensure... 

Sunrift Adventures

Remote Data Entry Keyer Job at Sunrift Adventures

This is a remote position. As a Remote Data Entry Keyer, youll play a pivotal role in maintaining and enhancing the accuracy of Sunrifts back-office data including inventory records, customer and rental transactions, vendor information, and sales archives. Given...