The coding platform that empowers everyone to learn
Replit is a collaborative coding platform that simplifies programming for learners, educators, and developers. Based in SoMa, San Francisco, Replit has attracted millions of users, including employees from major tech companies like Google, Facebook, and Stripe. The company has raised $472.2 million ...
Replit offers a remote-first work environment with flexible hours, equity options, and a home office setup stipend. Employees enjoy comprehensive heal...
Replit's culture is centered around accessibility in coding, allowing users to start programming without complex setups. The company values innovation...
Replit • Foster City, CA (Hybrid) In office M,W,F
Replit is hiring a Data Scientist to enhance their AI agent by designing experiments and analyzing data to drive improvements. You'll work with Python and SQL to connect data insights to user outcomes. This role requires experience in data analysis and experimentation.
You have a strong background in data science, with experience in designing and analyzing experiments that measure improvements in AI systems. Your expertise in statistical methods allows you to define success metrics that connect data to user outcomes effectively. You are proficient in Python and SQL, enabling you to build data models and perform in-depth analyses. You understand the importance of collaboration and can partner effectively with engineering and product teams to translate data insights into actionable decisions. You are passionate about making programming accessible and are excited to contribute to a mission that democratizes software development. You thrive in a hybrid work environment, balancing in-office collaboration with remote flexibility.
Experience with AI or machine learning projects is a plus, as is familiarity with data engineering practices. You may have worked in cross-functional teams and have a knack for communicating complex data insights to non-technical stakeholders.
In this role, you will directly impact Replit's AI agent by defining how success is measured and designing experiments that drive improvements. You will analyze agent trace data, including prompts, responses, and execution outcomes, to derive actionable insights that enhance user experiences. You will collaborate with AI engineering and product teams to ensure that data-driven decisions shape the product roadmap. Your work will involve building a semantic layer for agent data in partnership with data engineering, defining the necessary tables and metrics for self-serve analysis. You will surface insights from your analyses to identify failure modes and successful patterns, ultimately improving agent effectiveness. You will have a seat at the table for strategic discussions, influencing the direction of the AI team and the company as a whole.
Replit fosters an inclusive culture that values diverse perspectives and experiences. You will be part of a team that is committed to making programming more accessible worldwide. The company offers a hybrid work model, allowing you to work in the office on designated days while also enjoying the flexibility of remote work. You will have opportunities for professional growth and development as you contribute to a mission-driven organization that is redefining software creation.
Apply now or save it for later. Get alerts for similar jobs at Replit.
