Senior Data Integration Operations Engineer

NU USA Northeastern University

Where
Boston, MA (Main Campus)
Pay
$131K a year

Posted 4 months ago· Checked live at NU USA Northeastern University 3 days ago

Stale: open 127 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what NU USA Northeastern University asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on NU USA Northeastern University's own hiring page 3 days ago.
What is the job?
Northeastern University is seeking an experienced and technically skilled Sr. Data Integration & Operations Engineer to join our team. This role is responsible for the day-to-day management, monitoring, operational support, and optimization of the university’s data integration pipelines and processes.
What does it pay?
$131K a year, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Northeastern University is seeking an experienced and technically skilled Sr. Data Integration & Operations Engineer to join our team. This role is responsible for the day-to-day management, monitoring, operational support, and optimization of the university’s data integration pipelines and processes.

Minimum Qualifications

  • Data Integration Platform Experience: Hands-on experience administering and operating enterprise data integration platforms, with Informatica PowerCenter or IDMC (Intelligent Data Management Cloud) strongly preferred. Experience with SaaS-based ELT tools such as Fivetran is a plus. Candidates should demonstrate the ability to manage complex integration workflows, configure connectors, and troubleshoot pipeline failures end-to-end.
  • Data Pipeline Operations: Extensive experience maintaining, scheduling, and troubleshooting data integration pipelines that extract from enterprise source systems (ERP, SIS, CRM, HR, finance) and load into data lakehouse and downstream operational applications. Strong SQL/Python skills are required for data validation, troubleshooting, and ad hoc investigation of pipeline issues. Familiarity with lakehouse architecture concepts (medallion architecture, incremental loads, schema management) is expected.
  • Data Observability and Pipeline Monitoring: Experience with data observability platforms (such as Monte Carlo, Acceldata, Anomalo, or Datafold) or equivalent pipeline monitoring tools that track data freshness, volume, quality, and schema changes strongly preferred. Proficiency in designing alerting frameworks that surface meaningful signals without generating excessive noise.
  • Incident Management: Strong experience in troubleshooting, diagnosing, and resolving AI system and data infrastructure issues, with the ability to prioritize incidents based on business impact.
  • Performance Optimization: Knowledge of techniques to optimize AI system and data pipeline performance, including resource allocation, scaling strategies, and performance tuning.
  • Change Management: Experience implementing changes to production AI systems and data pipelines with minimal disruption, including testing, validation, and rollback procedures.
  • Data Quality Management: Strong understanding of data quality principles as they apply to integration pipelines, including detection and remediation of issues such as missing records, null rates, duplicate data, schema drift, and late-arriving data. Ability to identify data quality failures before they affect downstream analytics consumers or operational applications.
  • Documentation and Knowledge Management: Excellence in creating and maintaining operational documentation, runbooks, and knowledge articles for AI systems and data pipelines.
  • Automation Skills: Ability to create and implement automation scripts and workflows to streamline routine operational tasks for both AI systems and data flows, enhancing overall system reliability.
  • DevOps Practices: Familiarity with DevOps and CI/CD principles as applied to AI systems and data pipelines, including containerization, orchestration, and infrastructure as code.
  • Security Awareness: Understanding of security best practices for AI operations and data handling, including access control, data protection, and vulnerability management.
  • Collaboration Skills: Strong ability to work with cross-functional teams, communicate technical concepts clearly, and coordinate incident response activities effectively.
  • Problem-solving: Excellent analytical and problem-solving skills, with the ability to troubleshoot complex issues in AI systems and data infrastructure in a methodical and efficient manner.
  • Compliance Knowledge: Understanding of relevant regulations and compliance requirements affecting AI systems and data processing in higher education environments.
  • Communication Skills: Clear and concise communication abilities, both written and verbal, to document procedures, report incidents, and coordinate with stakeholders.
  • Service Management: Knowledge of IT service management principles and frameworks, with experience applying them to AI and data pipeline operations.
  • Bachelor’s degree in Computer Science, Information Technology, Data Management, or a related field; technical certifications in relevant areas (e.g., Informatica, cloud data platforms, data engineering) preferred.
  • Minimum of 4–5 years of experience in data integration, data engineering operations, or a closely related IT operations role, with demonstrable hands-on experience operating enterprise ETL/ELT pipelines in a production environment.
  • Experience with cloud platforms (AWS, Azure, or GCP) and familiarity with cloud-based data lakehouse or data warehouse platforms (e.g., Snowflake, Databricks, Microsoft Fabric, or Delta Lake). Understanding of data lakehouse architecture principles including medallion architecture, incremental load patterns, and schema evolution.

Key Responsibilities & Accountabilities

Pipeline Monitoring, Observability, and Incident Management

Monitor data integration pipeline health, data freshness, volume trends, and job completion status using observability tools and dashboards. Proactively detect anomalies — such as late-arriving data, row count deviations, schema changes, or silent failures — before they cause downstream impact to the lakehouse or operational applications. Detect, triage, and resolve incidents in a timely manner, coordinating with source system owners and technical teams as needed.

Operational Support and Maintenance

Administer and maintain data integration platform environments (Informatica and related tools), including job scheduling, connector configuration, data refreshes, and platform patching. Manage integration jobs that feed both the data lakehouse and downstream point solutions used across the university. Implement scheduled maintenance activities with minimal disruption to dependent systems, and manage user access and permissions according to security policies.

Performance Analysis and Optimization

Analyze integration pipeline performance metrics, identify bottlenecks, long-running jobs, and resource contention, and implement tuning and optimization measures. Contribute to the evaluation and implementation of the university’s data observability platform, helping define the monitoring strategy, key metrics, SLA thresholds, and alerting rules that will govern pipeline health across the integration landscape.

Documentation and Knowledge Management

Create and maintain comprehensive operational documentation, including runbooks, standard operating procedures, and knowledge base articles. Document system configurations, data pipeline dependencies, and recovery procedures to ensure operational continuity.

Continuous Improvement and Automation

Identify opportunities to automate repetitive operational tasks, improve pipeline reliability, and reduce manual intervention. Develop and implement scripts and workflows to streamline routine integration operations. Contribute to the ongoing evaluation of integration tools (including Fivetran) and the evolution of the university’s data integration practices based on operational experience and emerging best practices.

Position Type

Information Technology

Additional Information

Northeastern University considers factors such as candidate work experience, education and skills when extending an offer.

Northeastern has a comprehensive benefits package for benefit eligible employees. This includes medical, vision, dental, paid time off, tuition assistance, wellness & life, retirement- as well as commuting & transportation. Visit https://hr.northeastern.edu/benefits/ for more information.

All qualified applicants are encouraged to apply and will receive consideration for employment without regard to race, religion, color, national origin, age, sex, sexual orientation, disability status, or any other characteristic protected by applicable law.

Compensation Grade/Pay Type

114S

Similar open jobs

Operations jobs in Boston (194)Jobs in Boston (7098)