Databricks Platform & Database Engineer

CoStar Realty Information, Inc.

Where
US-VA Arlington
Pay
$136K to $177K a year
Type
Full time

Posted 3 months ago· Checked live at CoStar Realty Information, Inc. 3 days ago

Stale: open 111 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what CoStar Realty Information, Inc. asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on CoStar Realty Information, Inc.'s own hiring page 3 days ago.
What is the job?
Databricks Platform & Database Engineer Job Description
What does it pay?
$136K to $177K a year, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Databricks Platform & Database Engineer

Job Description

CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index, CoStar Group is on a mission to digitize the world’s real estate, empowering all people to discover properties, insights and connections that improve their businesses and lives.

Responsibilities

  • Deploy, administer, and maintain Databricks workspaces on AWS, including workspace configuration, network settings, access management, Runtime versions, cluster configurations, libraries, and init scripts across dev, staging, and production
  • Manage Unity Catalog objects (catalogs, schemas, tables, external locations) and administer workspace security: users, groups, service principals, permissions, and enterprise identity provider integrations
  • Lead platform upgrades, workspace migrations, and full environment lifecycle management
  • Monitor, optimize and right‑sizing clusters, SQL warehouses, and job compute for performance and cost; analyze Spark executor logs and query plans to diagnose and resolve bottlenecks
  • Support data ingestion from relational and non-relational sources into Databricks via AWS, DMS or native Lakeflow ingestion services
  • Lead the design and implementation of end-to-end data workflows, covering the reliable distribution of curated data to downstream systems including SQL Server, DynamoDB, S3, and other enterprise data consumers.
  • Design, implement, and administer relational and non-relational databases such as SQL Server, Aurora, PostgreSQL, MySQL, and DynamoDB across AWS (RDS/Aurora) and on-premises data centers
  • Manage provisioning, patching, backups, replication, failover, version upgrades, and cross-platform migrations between cloud and on-premises environments
  • Apply database security best practices including encryption at rest and in transit, access control, and auditing
  • Develop IaC solutions using Terraform for Databricks workspaces, AWS RDS, Aurora, and supporting resources
  • Automate operational tasks: cluster lifecycle, database provisioning, job scheduling, and backup management across cloud and on-premises environments
  • Build and maintain CI/CD workflows for platform configuration and pipeline code
  • Implement proactive monitoring and alerting across Databricks jobs, pipelines, clusters, SQL warehouses, and all database instances
  • Implement and enforce cluster policies, SQL warehouse governance, and workspace hardening.
  • Manage Databricks audit logs, lineage, and compliance reporting
  • Support SLA-driven 24/7 production environments; lead root cause analysis, troubleshoot incidents, and author operational runbooks
  • Partner with data scientists, business analysts, DBAs, and DevOps engineers to deliver platform implementations and respond to ad-hoc data needs

Basic Qualifications

  • Bachelor’s Degree required from an accredited, not for profit, in person, university or college.
  • A track record of commitment to prior employers.
  • Familiarity with large language models (LLMs), prompt engineering, or agent-based architectures.
  • 5+ years of experience in database engineering or data platform roles, across both relational/non-relational database administration and Databricks platform ownership
  • Proven, hands-on experience administering enterprise Databricks environments
  • Collaborate with cross-functional teams: Work closely with business analysts, data scientists, DBAs, and DevOps engineers to ensure successful data platform implementations.
  • Ability to retrieve, synthesize, and present critical data in structures that is immediately useful to answering specific ad-hoc questions
  • Knowledge of data governance and compliance best practices.
  • Deep expertise in Databricks platform administration: Unity Catalog, workspace security, cluster management, and Auto Loader on AWS
  • Strong relational database engineering skills: schema design, query optimization, indexing, stored procedures, replication, and failover across SQL Server, Aurora, PostgreSQL, and/or MySQL
  • Advanced SQL and proficiency in PySpark and Python
  • Infrastructure-as-Code experience with Terraform; CI/CD pipeline management
  • Experience with cost optimization initiatives.
  • Experience supporting 24/7 operational environments
  • Experience with data governance frameworks, compliance practices, and cloud cost optimization

Preferred Qualifications

  • Working knowledge of Data Visualization tools like Looker and PowerBI
  • Working knowledge of non-relational databases: DynamoDB, MongoDB, or equivalent NoSQL platforms
  • Familiarity with AI governance frameworks, model lineage, auditability, and compliance
  • requirements for ML systems
  • Experience with kafka or other real-time streaming platforms, Postgres/RDBMS
  • Experience with Snowflake Administration
  • Experience working with and managing large consumer datasets to derive insights
  • Experience with FinOps / cloud cost optimization
  • Experience implementing access controls, data privacy protections, and monitoring for AI workloads.
  • Familiarity with ML tooling: MLflow, TensorFlow, PyTorch, or Scikit-learn
  • Understanding of Lakehouse AI architecture and how ML pipelines integrate with Unity Catalog and Delta Lake

We welcome all qualified candidates who are currently eligible to work full-time in the United States to apply. However, please note that CoStar Group is not able to provide visa sponsorship for this position.

The final salary or hourly rate offered for this role will fall within the range set forth below based on a variety of factors, including but not limited to, geographic location, skills, and competencies.

Base Compensation: $136,000 - $177,000 annually.

CoStar Group is an Equal Employment Opportunity Employer; we maintain a drug-free workplace and perform pre-employment substance abuse testing

CoStar Group is an Equal Employment Opportunity Employer; we maintain a drug-free workplace and perform pre-employment substance abuse testing