Remote job
Proprietary Intelligence Engineer: Local Government
Job details
About this role
Role overview Build production data and intelligence systems focused on municipal records, local public institutions, regional regulation and public funding. You will take work from source discovery and large-scale collection through data processing and model-based analysis to APIs and applications used by public-sector decision-makers.
Responsibilities - Create robust collection pipelines for municipal documents, web sources, PDFs, XML and undocumented APIs. - Build ETL/ELT workflows and warehouse data in systems such as PostgreSQL, Elasticsearch, object storage and Snowflake. - Design schemas and optimize queries to support reliable access to complex, sparse records. - Apply language models and NLP to entity resolution, document classification, sentiment analysis and summarisation. - Deliver client-facing APIs and applications, including FastAPI services deployed with Docker and Kubernetes. - Add explicit error handling, data integrity checks and proactive alerts; work directly with public-sector stakeholders on production systems.
Requirements - Strong Python skills, including asynchronous programming, typing and performance; relevant tools include Scrapy, FastAPI, SQLAlchemy, pandas and asyncio. - Strong SQL and PostgreSQL skills, including CTEs, window functions, query plans, indexing and partition design. - Deep familiarity with Linux debugging and Docker-based deployments. - Experience building reliable production pipelines and deploying models or embeddings in high-stakes settings. - A strict commitment to legal compliance, contractual obligations and privacy boundaries.
Benefits and work setup - Remote flexibility within EU working hours, with regular team offsites and international travel. - Competitive base compensation; equity may be discussed for suitable candidates. - Performance rewards tied to direct contribution, plus private healthcare.