We are looking for an experienced Data Engineer to lead architecture and development work on our platform. Your role will include:
· Building pipelines to crawl, clean, and structure large datasets that form the basis of our platform and IP.
· Define architecture, evaluate tools and open source projects to use within our environment
· Take a leading part in the development of our enterprise-grade technology platform and ecosystem.
· At least 5 years experience with data engineering in Python (or equivalent language)
· Experience with cloud platforms (AWS, Google GCP, Azure), working on production payloads on large scale and complexity. Experience in working with Docker/Kubernetes a big plus.
· Experience in working on enterprise software, or data products.
· Big Advantage: Hands-on experience with data science tools, packages, and frameworks
· Big Advantage: Hands-on experience with ETL Flow