AI Software Engineer
Software Engineering, Data Science
Toronto, ON, Canada
Posted on Aug 28, 2026
CultureWe treat your time as the scarce asset that it is. We respect people being heads-down and having the time to get into a flow. Distractions and context switching are things we work to minimize. We have meetings for specific purposes, and leverage async channels when appropriate.Mash has an open and direct culture. We believe that not making a decision is a decision – and a terrible one at that. We have strong conviction and a bias for action. We can agree to disagree, and move forward after reviewing the details. As we learn, we will reevaluate, iterate and push forward.Role & responsibilitiesAs an AI-focused software engineer on the Mash team, you will:- Ship core AI features within the Mash platform. - Architect LLM-powered solutions and manage related infrastructure. - Apply information retrieval techniques for search and retrieval-augmented generation (RAG), working with embedding models and vector databases. - Develop processes and tooling for measuring and iterating on LLM output quality, leveraging eval frameworks and observability platforms. - Create tooling to collect and leverage internal datasets for evaluation, few-shot prompting, fine-tuning and more. - Develop bespoke ML/NLP models, when appropriate.- Build production data pipelines to ingest knowledge sources.- Stay up to date on cutting-edge research in the ML/NLP space and identify opportunities to apply new techniques within the Mash platform.- Work closely with a cross-functional team (product, design, engineering).- Discover and understand user needs.Our stack- Application: Python, FastAPI, TypeScript, Tailwind CSS, NextJS.- Infrastructure: GCP, Weaviate, PostgreSQL, Terraform, Docker.Skill set- 4+ years of experience in at-scale software development with a focus on AI. - Expertise building production systems with LLMs and/or traditional ML/NLP models. - Experience with information retrieval techniques and/or vector databases.- Proficiency in 1+ programming languages, such as Python, Go, Rust, C++, or Java.- Expertise in working with data (both structured and unstructured) and developing data pipelines.- Experience building cloud-native software (with cloud providers such as Google Cloud Platform, Amazon Web Services, Microsoft Azure, etc.).- Strong understanding of backend system design and scalable architectures.- Bonus: experience with eval frameworks and knowledge of best practices for LLM evaluation and observation.Cultural fitWe’re looking for an individual who:- Responds well to open-ended problems and thrives on autonomy – is a self-starter and problem solver.- Thrives in collaborative environments and is laser-focused on team goals.- Has great communication skills.- Has a passion for lifelong learning.How to applyPlease reach out to us at careers@mash.com – and include a bit about yourself, your resume, and three bullet points about why you are specifically interested in the position.