Everything Beady does starts with the pipelines that pull from more than 100,000 public sources: company registries, court and enforcement records, sanctions lists and watchlists, news and social media. You’d own the part that keeps them running, complete and up to date.
What you’d do
- Build and maintain collectors for registries, court systems, regulators, sanctions lists and media
- Keep sources alive when they change format, rate-limit or simply go down
- Design storage and indexing for hundreds of millions of entities and their documents
- Make every record traceable back to the page it came from
What we look for
- Strong Python (or Go / Java) and SQL, and comfortable with queues, schedulers and distributed workers
- Real experience with large-scale crawling or ETL, and with messy, inconsistent data
- You care about getting it right: a record we miss isn’t a bug, it’s a compliance failure
Send your CV and a couple of lines on why this role to hello@beady.ai.