Lead Data Engineer

Brown & Brown, Inc

Where
Plano, TX, USA

Posted 24 days ago· Checked live at Brown & Brown, Inc 3 days ago

Stale: open 24 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Brown & Brown, Inc asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Brown & Brown, Inc's own hiring page 3 days ago.
What is the job?
Built on meritocracy, our unique company culture rewards self-starters and those who are committed to doing what is best for our customers. Brown & Brown is seeking a Lead Data Engineer to join our growing team in Plano, TX!
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Built on meritocracy, our unique company culture rewards self-starters and those who are committed to doing what is best for our customers.

Brown & Brown is seeking a Lead Data Engineer to join our growing team in Plano, TX!

Required Qualifications

  • Bachelor’s degree in computer science, Engineering, Mathematics, Information Systems, or a related STEM field, or equivalent education and professional experience.
  • 8+ years of experience in data engineering or related software/data engineering disciplines, including significant hands-on experience building and supporting production data solutions.
  • Strong hands-on experience with Databricks, Apache Spark/PySpark, Delta Lake, Python, and SQL. Experience designing and operating production-grade batch and streaming data pipelines. Experience with Databricks capabilities such as Lakeflow Declarative Pipelines, Databricks Jobs, Auto Loader, Structured Streaming, Delta Lake, and Unity Catalog.
  • Experience designing reliable workflow orchestration, including scheduling, dependencies, parameters, retries, notifications, and operational monitoring.
  • Experience implementing data governance and access controls with Unity Catalog, including catalogs, schemas, tables, views, external locations, storage credentials, lineage, and fine-grained permissions.
  • Experience with Terraform, Databricks Asset Bundles, or comparable Infrastructure as Code approaches, along with Git and CI/CD practices.
  • Strong experience troubleshooting and optimizing Spark workloads using tools and techniques such as Spark UI, job logs, query plans, partitioning, join optimization, and Adaptive Query Execution.
  • Strong understanding of conceptual, logical, relational, dimensional, and physical data modeling.
  • Experience delivering ETL/ELT solutions through the complete engineering lifecycle, from requirements and design through deployment and production support.
  • Demonstrated ability to balance engineering quality, delivery speed, scalability, resiliency, and cost while making pragmatic technical trade-offs.
  • Strong problem-solving skills with demonstrated ability to diagnose and resolve complex data and production issues.
  • Demonstrated technical leadership, including solution design, code reviews, engineering standards, mentoring, and team unblocking.
  • Ability to influence technical direction, facilitate alignment, and build consensus across engineering teams and stakeholders without relying on formal authority.
  • Experience working within Agile delivery models such as Scrum, Kanban, or SAFe.

Preferred Qualifications

  • Prior experience serving as a technical lead, lead engineer, or senior engineer with responsibility for technical design and engineering standards.
  • Advanced Python and/or Scala development experience.
  • Experience with cloud platforms such as Microsoft Azure, AWS, or Google Cloud.
  • Experience with cloud storage technologies such as Azure Data Lake Storage Gen2, Amazon S3, OneLake, or Google Cloud Storage.
  • Experience with modern data platforms and open table technologies such as Snowflake, Apache Iceberg, Apache Hudi, or BigQuery.
  • Experience with messaging and event-streaming technologies
  • Experience with NoSQL technologies such as Cassandra or HBase.
  • Experience designing or consuming REST APIs and web services.
  • Experience developing governed data products supporting AI, Generative AI, Machine Learning, semantic models, APIs, advanced analytics, Genie Spaces, or AI agents.
  • Experience implementing enterprise-scale data governance, data quality, metadata, and lineage capabilities.
  • Experience working with insurance, Health data.
  • Practical experience using AI-assisted development tools such as GitHub Copilot, Claude, or Databricks AI-assisted development capabilities to improve engineering productivity.

Teammate Benefits & Total Well-Being

We go beyond standard benefits, focusing on the total well-being of our teammates, including:

  • Health Benefits: Medical/Rx, Dental, Vision, Life Insurance, Disability Insurance
  • Financial Benefits: ESPP; 401k; Student Loan Assistance; Tuition Reimbursement
  • Mental Health & Wellness: Free Mental Health & Enhanced Advocacy Services
  • Beyond Benefits: Paid Time Off, Holidays, Preferred Partner Discounts and more.

Not reflective of all benefits. Enrollment waiting periods or eligibility criteria may apply to certain benefits. Benefit details and offerings may vary for subsidiary entities or in specific geographic locations.

Recruiting Vendor Disclosure Statement

Brown & Brown does not accept unsolicited resumes from external recruiters, recruitment vendors or employment agencies ("Recruiting Vendors"). Recruiting Vendors must have a valid written agreement and received prior written authorization from an authorized Brown & Brown representative before submitting candidates for any publicly posted role. Any unsolicited resumes submitted to Brown & Brown or its employees become the property of Brown & Brown, and no fees will be paid for such submissions. Additional information regarding this policy can be found on our careers page.

The Power To Be Yourself

As an Equal Opportunity Employer, we are committed to fostering an inclusive environment comprised of people from all backgrounds, with a variety of experiences and perspectives, guided by our Diversity, Inclusion & Belonging (DIB) motto, “The Power to Be Yourself”.

Similar open jobs

Data engineer jobs in Dallas (24)Jobs in Dallas (4957)