Principal AI Platform and Model Operations Engineer - TS/SCI with Polygraph

GD Information Technology, Inc.

Where
USA VA Chantilly
Pay
$162K to $219K a year

Posted 14 days ago· Checked live at GD Information Technology, Inc. 4 days ago

Talent poolAn always-open posting that collects resumes. There may be no real opening behind it.

See how you score for this job

One sentence and your resume. We score it against what GD Information Technology, Inc. asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on GD Information Technology, Inc.'s own hiring page 4 days ago.
What is the job?
Regular Top Secret SCI + Polygraph
What does it pay?
$162K to $219K a year, as the posting states.
Our verdict
Talent pool. An always-open posting that collects resumes. There may be no real opening behind it.

What the job is

Regular

Top Secret SCI + Polygraph

Top Secret SCI + Polygraph

None

Data Science and Data Engineering

Yes

We are seeking a hands-on AI Platform Operations Engineer to own and mature the end-to-end platform and lifecycle mechanisms that move AI models, prompts, retrieval assets, dependencies, and services from approved development into reliable, classified production environments.

8 + years of related experience US Citizenship Required

Yes

Key Responsibilities

  • Design and operate AI/ML platform services for local model serving, orchestration, model and artifact registries, experiment/evaluation tracking, feature or retrieval assets, and deployment automation.
  • Build controlled import and release workflows for model weights, containers, Python packages, libraries, prompts, datasets, and vulnerability updates in disconnected environments.
  • Implement provenance, checksums/signing, SBOMs, malware/vulnerability scans, license review, allowlists, approvals, staged validation, and rollback for AI artifacts.
  • Deploy and tune inference services using approved serving stacks; manage batching, concurrency, memory, quantization, autoscaling where available, queueing, resilience, and graceful degradation.
  • Establish versioning and release relationships among model, tokenizer, prompt, retrieval index, embedding model, configuration, evaluation set, application, and infrastructure.
  • Develop GPU/CPU/storage/network capacity models and advise on hardware options, consolidation, scheduling, and cost/performance trade-offs.
  • Implement health, latency, throughput, saturation, failure, quality, drift, and usage telemetry integrated with enterprise observability and ServiceNow.
  • Define backup/recovery, continuity, patching, vulnerability treatment, certificate/secret rotation, and incident procedures for AI platform services.
  • Partner with AI Assurance and Security to enforce use-case gates, evaluation thresholds, audit, data restrictions, and release evidence.
  • Lead technical reviews, troubleshoot production AI platform incidents, mentor engineers, and document reusable platform patterns.

Required Qualifications

  • Education: Bachelor’s degree in computer science, Software Engineering, Machine Learning, Information Technology, or related field, or approved equivalent experience.
  • Location: Onsite
  • Clearance: Active TS/SCI with Polygraph
  • 8+ years of platform, DevSecOps, SRE, ML engineering, or cloud engineering experience, including 3+ years supporting production AI/ML platforms.
  • Hands-on experience deploying and operating local model-serving platforms such as vLLM, TGI, Triton, TensorRT-LLM, llama.cpp, Ollama, ONNX Runtime, or comparable technologies.
  • Strong Linux, container, Kubernetes/OpenShift, networking, storage, GPU, identity, secrets, and infrastructure automation skills.
  • Experience with model/artifact registries, experiment tracking, release management, CI/CD, internal package/container repositories, and disconnected dependency management.
  • Ability to size inference capacity using model precision, VRAM, context length, concurrency, throughput, latency, and availability requirements.
  • Strong Python and automation proficiency plus experience with Terraform, Ansible, Helm, GitLab CI/Jenkins, or comparable tooling.
  • Working knowledge of RMF/STIG, software supply-chain security, SBOMs, vulnerability management, logging/audit, and classified data handling.
  • Demonstrated technical leadership, incident judgment, cross-team coordination, mentoring, and clear documentation.

Preferred Qualifications

  • Experience with PyTorch, Hugging Face, MLflow, Kubeflow, Ray, NVIDIA GPU tooling, CUDA, or enterprise AI platform products.
  • Experience operating A100, H100, L40S, or comparable accelerators and performing quantization/optimization.
  • Experience with Azure Government, AWS GovCloud, C2S-equivalent, or on-premises platform delivery.
  • Role-relevant CKA/CKS, current Red Hat platform engineering credentials, or Microsoft Certified: DevOps Engineer Expert. Relevant Terraform, NVIDIA or ML-platform credentials
  • Experience integrating model-quality/evaluation signals with deployment gates and production monitoring.

Total Rewards at GDIT

Our benefits package for all US-based employees includes a variety of medical plan options, some with Health Savings Accounts, dental plan options, a vision plan, and a 401(k) plan offering the ability to contribute both pre and post-tax dollars up to the IRS annual limits and receive a company match. To encourage work/life balance, GDIT offers employees full flex work weeks where possible and a variety of paid time off plans, including vacation, sick and personal time, holidays, paid parental, military, bereavement and jury duty leave. To ensure our employees are able to protect their income, other offerings such as short and long-term disability benefits, life, accidental death and dismemberment, personal accident, critical illness and business travel and accident insurance are provided or available. We regularly review our Total Rewards package to ensure our offerings are competitive and reflect what our employees have told us they value most.