Data Engineering Manager

The Software Engineering Manager will lead the Data Platform Sources team in developing software that extracts, cleans, and normalizes data from government websites and other data sources. The software will be based on data integration frameworks and pipeline architectures developed by the Verifiable.com Data Engineering team. The Software Engineering Manager will be responsible for defining projects, hiring and training the necessary permanent and temporary talent for executing these projects, and directly reviewing code and enforcing quality standards.

Responsibilities:

Manage a team of software engineers, providing technical guidance and direction
Define projects and establish timelines and deliverables
Hire and train software engineering talent to meet project needs
Review code and ensure quality standards are met
Collaborate with the core Verifiable.com team to use and extend our web scraping and data frameworks

Requirements:

At least 5 years of experience of direct involvement in software development, writing production code for data or backend applications
At least 2 years experience managing teams as a team lead; track record of success delivering high-quality projects in tight time frames.
Previous experience in assembling and coordinating a team of outsourced developers to execute on short term projects in collaboration with a core architecture team
Familiarity in navigating team project definitions characterized by high volume and low- to-moderate complexity - the team will be integrating a large number of data sources where the implementation of each individual source is usually relatively straightforward
Experience implementing software development best practices such as Scrum
Excellent written and verbal communication skills
Experience developing web scrapers that can circumvent bot detection, rate limits, and IP restrictions
Experience with writing jobs in workflow orchestrators such as Airflow, Dagster or Prefect
Experience developing ETL transformations in SQL