Senior Software Engineer – Network Observability

Clockwork.io

Where
On Site, Palo Alto, California
Pay
$140K to $210K a year

Posted 9 days ago· Checked live at Clockwork.io 30 minutes ago

Live.Open on the employer's own site.

See how you score for this job

One sentence and your resume. We score it against what Clockwork.io asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Clockwork.io's own hiring page 30 minutes ago.
What is the job?
Clockwork.io – Software Driven Fabrics to increase GPU cluster utilization Clockwork Systems was founded by Stanford researchers and veteran systems engineers who share a vision for redefining the foundations of distributed computing. As AI workloads grow increasingly complex, traditional infrastructure struggles to meet the demands of performance, reliability, and precise coordination.
What does it pay?
$140K to $210K a year, as the posting states.
Our verdict
Live. Open on the employer's own site.

What the job is

Clockwork.io – Software Driven Fabrics to increase GPU cluster utilization

Clockwork Systems was founded by Stanford researchers and veteran systems engineers who share a vision for redefining the foundations of distributed computing. As AI workloads grow increasingly complex, traditional infrastructure struggles to meet the demands of performance, reliability, and precise coordination.

What You Will Do

  • Design, develop, and scale high-performance network monitoring platforms for RDMA, RoCE, InfiniBand, and TCP/IP infrastructure.
  • Build backend telemetry services, observability dashboards, alerts, diagnostics, anomaly detection, SLA monitoring, and traffic analysis workflows.
  • Troubleshoot complex production issues across application, OS, server, RDMA, and network layers while optimizing low-latency collection, aggregation, and alerting.
  • Collaborate with cross-functional teams to deliver scalable solutions, improve engineering practices, automate operational workflows, and contribute to the technical direction of the platform.

What We’re Looking For

  • Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related technical field.
  • Strong hands-on programming experience in C++, Go, Python, Rust, or similar systems programming languages.
  • Proven experience delivering complex infrastructure projects and contributing to the design and implementation of distributed systems.
  • Experience building distributed systems, backend services, telemetry pipelines, or observability platforms.
  • Hands-on experience with RDMA, RoCE, InfiniBand, or other high-performance network fabrics.
  • Familiarity with libibverbs, RDMA verbs, RDMA CM, queue pairs, completion queues, memory registration, and related RDMA concepts.
  • Strong knowledge of Linux networking, TCP/IP, DNS, HTTP, routing, MTU, congestion control, packet loss, latency, and performance tuning.
  • Experience with traceroute-style diagnostics, path discovery, network reachability checks, synthetic probes, or active network measurements.
  • Experience with monitoring and visualization platforms such as Prometheus, Grafana, Datadog, Splunk, OpenTelemetry, or similar tools.
  • Strong debugging skills across software, operating system, server, and network layers.
  • Experience operating production systems in Linux-based environments.
  • Strong technical judgment and ability to build reliable, scalable, and maintainable systems.

Nice to Have

  • Experience supporting AI/ML, HPC, storage, or GPU cluster infrastructure workloads.
  • Experience with large-scale RoCE or InfiniBand deployments.
  • Experience with NCCL, distributed training infrastructure, or AI cluster diagnostics.
  • Experience with eBPF, XDP, DPDK, perf, tcpdump, Wireshark, ethtool, iproute2, rdma-core, or Linux kernel networking tools.
  • Experience with cloud infrastructure on AWS, GCP, or Azure.
  • Experience with Kubernetes, service discovery, configuration management, and infrastructure automation.
  • Knowledge of security, compliance, and infrastructure best practices.
  • Experience designing time-series data systems, alerting pipelines, or high-cardinality telemetry platforms.

Similar open jobs

Software engineer jobs in San Jose (1462)Jobs in San Jose (7796)