Software Engineer, Big Data

Role overview

The Software Engineer, Big Data builds large-scale data systems and machine-learning infrastructure for an online employment marketplace serving millions of job seekers and many business customers. The role involves developing scalable processing pipelines, cloud-based services, and well-instrumented applications that support data-driven matching and other marketplace intelligence.

Responsibilities

- Build data-processing, data-exploration, and machine-learning infrastructure for high-volume intelligent applications. - Deploy and operate cloud technologies used by important engineering initiatives. - Develop, test, instrument, and release production code in containerized Kubernetes environments. - Contribute to the evolution of distributed systems, services, and processes that support marketplace functionality. - Write efficient, maintainable code that can evolve as data volume, product needs, and system complexity grow.

Requirements

- At least 2 years of professional software-development experience, particularly with Python and big-data technologies. - Experience with one or more of Spark, Kafka, Hadoop, Hive, or comparable data-processing systems. - Solid computer-science fundamentals, including coding, object-oriented programming, data structures, and algorithms. - Experience with containerization technologies such as Docker or Kubernetes.

Nice to have

- Four or more years of software-development experience focused on Python and big data. - A degree in mathematics, computer science, physics, or a related technical discipline, or equivalent practical experience. - Experience with data-integration tools such as Kafka, Flume, or NiFi. - Familiarity with storage technologies including Delta Lake, HBase, Cassandra, or MongoDB. - Exposure to Apache Hudi, Beam, Flink, Google Cloud Dataflow, Amazon Kinesis Data Analytics, or Azure Databricks.

Benefits and work setup

- Hybrid work is offered, and many U.S.-based positions may be performed remotely unless an exception is specified. - Listed benefits include competitive compensation, an extensive benefits package, flexible vacation and paid time off, and an employer-matched retirement plan. - The listed U.S. base salary range is $130,000–$175,000, with final pay influenced by location, experience, skills, education, and role-related factors. Additional compensation may include equity, bonuses, or other benefits.