Senior Data Engineer Role:

At Cainthus, we work together on talented cross-disciplinary teams to develop original computer vision-enabled products. As a Senior Data Engineer, your technical leadership, creativity and experience delivering access to data will improve the operations of dairy farms globally.

You will work side by side with world-class software engineers, computer vision engineers and data scientists in small, multi disciplinary teams solving high impact problems that have global importance in Agritech and the food chain.

 

About Cainthus:

Cainthus is a growing computer vision startup based in Dublin. We are a blend of computer vision specialists, engineers, designers, and data scientists, all from diverse backgrounds. We’re passionate about transforming farming through the use of our technology. We believe in taking ownership and want to be accountable for the work we do. We value transparency. We work together in agile multi-disciplinary teams and collaborate closely with a group of dairy farmers who ensure that our work has a meaningful impact on their farms. We love learning from each other, solving challenging problems and having fun along the way.

 

Senior Data Engineer Responsibilities:

  • Contribute to the Cainthus cloud solution architecture.
  • Create and maintain Cainthus data pipeline architecture.
  • Own data schemas and their evolution (working closely with the software architects).
  • Work with stakeholders across Product and Engineering to anticipate and plan for data-related technical issues and support their data infrastructure needs.
  • Write elegant, well-crafted code to optimise data accessibility and performance working across storage tiers (especially DynamoDB, PostgreSQL, S3).
  • Enable data access and systems securely in AWS cloud services.
  • Keep all stakeholders informed on application data formats, storage location, volume and access method performance.
  • Advise and mentor other developers in engineering best practices around data storage and access topics.
  • Help drive the underlying technology stack and the implementation methodology.

What we’re looking for

Senior Data Engineer Requirements:

  • Deep knowledge of Database and Data Storage systems, schemas and access patterns.
  • Advanced SQL knowledge and experience working with relational databases, query authoring as well as working familiarity with a variety of storage platforms.
  • Confident in creating and managing policy around data access, performance and security.
  • Strong analytical skills related to working with structured and unstructured data.
  • Excellent communication & problem-solving skills with the ability to work with a broad range of stakeholders.
  • Good experience maintaining and scaling Postgres and DynamoDB datasets.
  • Appreciation of Analytics and Machine Learning development and associated data needs.
  • Proficiency with AWS ecosystem or similar cloud components and products.
  • Deep and demonstrable experience in Python development and one other modern language.
  • Experience with building Docker container-based systems.
  • Experience using CI/CD pipeline (CircleCI, Jenkins, Code Deploy, etc.).
  • An inherent drive to tackle problems, collaborate with others and mentor team members in a fast-paced, high-growth, ever-changing startup environment.
  • A track record of solving complex problems with elegant solutions.

Nice to have

  • Experience with stream processing using Kinesis or Kafka.
  • Experience with time-series databases.
  • Experience in advanced data management using S3 storage, specifically around efficient storage and management of partitioned Parquet file (or other structured binary file formats).
  • Solid commercial experience in designing and building robust, scalable APIs and web applications in a Linux ecosystem.
  • Familiarity with orchestration platforms such as Kubernetes, AWS ECS, AWS EKS.

Value you’ll deliver

  • Enabling and providing secure, resilient, portable, and efficient cloud solutions.
  • Empowering development teams with self-service cloud and container solutions, growing agility and providing access to innovation.
  • Reducing development team operational overhead by evaluating, exploring, recommending and enabling managed cloud services.
  • Emphasis on writing clear, readable, testable, deployable and monitored code for server-side applications.

What we offer:

Joining our team has its rewards. We are remote flexible and also have offices to work from in Dogpatch Labs, a unique start-up community located in the historic CHQ Building in the heart of Dublin Digital Docklands. Here, you will have the opportunity to attend different events and meetups hosted by the tech community. Our benefits include:

  • Fully paid Group Health Cover for you and your immediate family;
  • Pension Scheme with 5% company matching;
  • 25 days paid holidays per year (21 days flexible and 4 set company days);
  • Generous ESOP Scheme;
  • Flexible Wellness Benefit;
  • Family-Friendly Benefits;
  • Bike to Work and Tax Saver schemes;
  • Management approved education and career development support.