Frontend Software Engineer

About The Company

Our mission is to scale intelligence to serve humanity. We’re training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, Retrieval-Augmented Generation (RAG), and autonomous agents. We believe that our work is instrumental to the widespread adoption of AI, and we are committed to advancing the capabilities of large language models (LLMs) to create impactful solutions.

We obsess over what we build. Each team member is responsible for contributing to increasing the capabilities of our models and the value they deliver to our customers. Our team comprises researchers, engineers, designers, and other specialists who are passionate about their craft and dedicated to pushing the boundaries of AI technology. We value diversity of thought and background, recognizing that a range of perspectives is essential for building innovative and effective products. Join us on our mission to shape the future of AI and make a meaningful difference in the world.

With offices in London, Paris, Toronto, San Francisco, and New York, and a flexible remote work policy, we foster an inclusive and dynamic work environment where talent from around the globe can thrive.

About The Role

As an Evaluation Frontend Software Engineer, you will play a vital role in our AI development ecosystem by creating tools that facilitate the analysis and visualization of model evaluation data. Your primary responsibility will be to develop intuitive and powerful visualization tools that enable researchers and engineers to compare and analyze hundreds of model evaluations stored in a centralized database. This role requires a blend of skills in frontend development, data visualization, statistics, and understanding of machine learning systems.

You will collaborate closely with cross-functional teams, including research scientists and backend engineers, to surface insights that inform the future development and refinement of our large language models. Your work will help us interpret experimental outcomes, identify signals amidst noisy data, and guide modeling decisions. This position offers an exciting opportunity to contribute directly to the advancement of cutting-edge AI models, helping shape the tools that drive model evaluation and improvement.

The ideal candidate will have a strong passion for data visualization, statistical analysis, and frontend engineering, with an interest in machine learning evaluation systems. We are open to applicants from diverse backgrounds who are eager to work at the forefront of AI research and development, regardless of geographic location, as we embrace a remote-friendly culture.

Qualifications

• Extremely strong software engineering skills, with proficiency in frontend development frameworks and tools.
• Strong statistical skills and experience evaluating scientific experiments related to data collection and model performance.
• Prior experience building front-end visualization systems and dashboards.
• Familiarity with machine learning system evaluations and related data workflows.
• Proficiency in programming languages such as Python and experience with ML frameworks like PyTorch, TensorFlow, or JAX.
• Excellent communication skills to collaborate effectively with cross-functional teams and present complex findings clearly.
• One or more publications at top-tier conferences or journals such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, or EMNLP.
• Ability to work independently and proactively in a fast-paced, innovative environment.

Responsibilities

• Design and develop visualization tools and dashboards that enable researchers and engineers to compare and analyze extensive model evaluation data effectively.
• Create statistical tools to extract meaningful signals from noisy evaluation metrics, aiding in model assessment and decision-making.
• Develop a deep understanding of the strengths and limitations of various model evaluation techniques and propose new evaluation facets to improve insights.
• Collaborate with research and engineering teams to understand their needs and translate them into functional, user-friendly visualization solutions.
• Maintain and improve existing visualization systems, ensuring scalability and robustness.
• Stay updated with the latest advancements in data visualization, statistical analysis, and machine learning evaluation methodologies.
• Contribute to documentation, best practices, and knowledge sharing within the team.

Benefits

• An open and inclusive culture fostering innovation and collaboration.
• Opportunity to work closely with a team at the cutting edge of AI research and development.
• Weekly lunch stipend, in-office lunches, and snacks to promote team bonding.
• Comprehensive health and dental benefits, including a dedicated budget for mental health support.
• 100% parental leave top-up for up to six months, supporting work-life balance.
• Personal enrichment benefits covering arts and culture, fitness, well-being, and workspace improvements.
• Flexible remote work options, with offices located in Toronto, New York, San Francisco, London, and Paris, plus a co-working stipend.
• Six weeks of vacation (30 working days) to ensure ample time for rest and rejuvenation.

Equal Opportunity

Cohere is committed to creating a diverse and inclusive work environment. We welcome applicants from all backgrounds and are dedicated to providing equal opportunities throughout the recruitment process. If you require accommodations during the application or interview process, please submit an Accommodations Request Form, and we will work with you to meet your needs. We believe that diversity fosters innovation and are proud to be an equal opportunity employer.