Job details
About this role
Role overview A Data Engineer is needed to build and maintain data pipelines and infrastructure powering AI-driven information discovery for a federal financial regulatory agency. The role supports natural language query, semantic search, and knowledge graph capabilities across an enterprise data platform, with onboarding of new data sources and continuous pipeline reliability.
Responsibilities - Build and maintain data pipelines feeding NLQ, semantic search, and knowledge graph capabilities on an enterprise data platform - Onboard new data sources and extend the semantic layer without disrupting live pipelines - Ingest, transform, and deliver XBRL and other financial filing datasets - Support GraphRAG and knowledge graph pipelines in collaboration with the data architect - Use AWS data services including Athena, DataZone, SageMaker, S3, and Lambda - Implement and maintain vector database and semantic search tooling - Own metadata management, data lineage, and data quality validation across the pipeline ecosystem - Monitor pipeline health, resolve data integration issues, and ensure compliance with federal security requirements
Requirements - Hands-on experience building enterprise data pipelines in regulated or federal environments - Strong SQL proficiency and experience with PostgreSQL or similar databases - Experience with ETL/ELT tools such as AWS Glue or Airflow - Proficiency in Python for pipeline development and automation - Experience with AWS data services (Athena, DataZone, S3, Glue, Lambda) - Familiarity with vector databases or semantic search tooling - Bachelor's degree - Must be authorized to work in the United States; some roles require U.S. citizenship and eligibility for a federal background investigation or security clearance
Nice to have - Experience with graph databases such as Neptune or Neo4j - Experience with XBRL or financial data schemas - Familiarity with FISMA and NIST 800-53 compliance frameworks
Benefits and work setup - Fully remote - Tech and education stipend - Comprehensive benefits package and 401(k) with company match - Flexible PTO and paid holidays - United States wage range: $100,000–$140,000, with actual offer determined by job category, location, and skill level