Data Engineer

About the role

Insight Xcite is seeking Data Engineers to build and maintain reliable data pipelines supporting mission-focused programs. Work includes integrating diverse data sources, transforming structured and unstructured data, improving data quality, and making data accessible within appropriate security boundaries.

Responsibilities, technology requirements, and experience levels vary by opening. We will discuss the specific assignment, location, and requirements with you during the interview process.

Key responsibilities

• Build, maintain, and troubleshoot data ingestion and ETL/ELT pipelines.
• Use Python and appropriate processing tools to transform and integrate data from multiple sources.
• Validate data accuracy, completeness, and consistency, and investigate failed or unreliable data feeds.
• Support data models, storage platforms, metadata, and documentation appropriate to the assignment.
• Work with engineering teams and stakeholders to clarify requirements and explain technical results.

Required qualifications

• Hands-on experience building or maintaining data pipelines and performing data extraction, transformation, and loading.
• Experience using Python for data processing or automation.
• Experience integrating diverse data sources and applying data-quality checks.
• Ability to troubleshoot problems independently and communicate clearly with technical and nontechnical audiences.

Education and experience requirements depend on the opening. Certain Expert-level assignments require at least 11 years of relevant experience.

Opening-specific technologies and responsibilities

Depending on the assignment, requirements may include

• Cloud and distributed data processing: AWS, HDFS, Cloudera, Spark, Presto, SQL, NoSQL, and enterprise data-flow integration.
• Operational data integration: tools such as NiFi or Cribl, log-data analysis, data-feed troubleshooting, Splunk, and work across network and security environments.
• Software-intensive data engineering: batch and real-time pipelines, APIs, microservices, Docker, CI/CD, infrastructure as code, and integration with application development.
• Analytics pipelines: PySpark, data mapping, JSON/XML processing, SQL databases, data-quality analysis, and source-to-target documentation.

These are different assignment profiles. Applicants are not expected to have every technology listed above.

Clearance Requirement

Applicants must currently possess an active TS/SCI with Full-Scope Polygraph. Insight Xcite does not sponsor or process security clearances at this time.

Work Location Requirement

These opportunities require onsite work at the designated location. Remote and hybrid arrangements are not offered.

Compensation

Annual base salary: $140,000–$220,000. Compensation depends on relevant experience, technical qualifications, role scope, and assignment requirements.

Candidate Authenticity and Use of AI

AI tools may be used to help format or draft application materials. All submitted information must accurately represent your own experience, qualifications, and work history. Be prepared to discuss and verify the information provided. Do not include classified or sensitive customer information.

About Insight Xcite

Insight Xcite is a mission-focused consulting firm supporting critical government programs through data-driven engineering, technology, cybersecurity, analytics, and operational expertise. We partner with customers across the national security community to deliver innovative solutions in highly secure, fast-paced environments.

Our teams are composed of experienced professionals who thrive on collaboration, accountability, and supporting mission success. We value technical excellence, integrity, and employees who are committed to solving complex challenges and making an impact.