Remote job
Data Engineer — Security Training Corpus
Job details
About this role
Role overview This position centers on engineering the data pipelines behind a security-focused training corpus used to develop machine learning models. The role supports a model engineering function and is offered on a full-time, fully remote basis. The work blends data engineering craft with domain awareness of security-related content.
Responsibilities - Design, build, and operate data pipelines that ingest, transform, and validate security-related source material - Curate, clean, and structure datasets to serve as a high-quality corpus for model training - Partner with model researchers and engineers to align data schemas, formats, and quality standards with downstream training requirements - Monitor pipeline reliability and data quality, investigating and resolving issues that affect the corpus - Maintain documentation of data lineage, transformations, and definitions for downstream consumers
Requirements - Hands-on experience as a data engineer working with substantial datasets and production pipelines - Proficiency with common data engineering languages and tooling for batch or streaming workflows - Familiarity with data validation, schema design, and quality assurance practices - Comfort working remotely and communicating asynchronously with a distributed team
Benefits and work setup - Full-time employment on a fully remote basis