Overview
join to apply for the senior applied scientist role at microsoft. Outlook is transforming how millions of users interact with ai through copilot and related initiatives. We are seeking a senior applied scientist to join a team at the forefront of this transformation, focusing on areas such as large language models (llms), prompt engineering, fine-tuning, evaluation, relevance, and responsible ai (rai).
as a member of the team, you will develop end-to-end infrastructure and measurement frameworks, foster cross-functional collaboration, and leverage data science and ai expertise to guide strategic decisions. You will work closely with multiple organizations and stakeholders to drive the evaluation and optimization of llm systems and related components.
microsoft’s mission is to empower every person and every organization on the planet to achieve more. We value growth, collaboration, inclusion, respect, integrity, and accountability.
responsibilities
* strategic technical leadership: develop and execute a comprehensive strategy for llm evaluation, covering quality, cost, model performance, utility (user experience and prompt effectiveness), and responsible ai considerations. Drive cost-effective solutions such as small language models (slms) or fine-tuned models.
* data science expertise: design experiments, analyze data, define okrs, and establish measurement frameworks to derive actionable insights that influence product direction and user experience based on evaluation outcomes.
* model and prompt evaluation: lead efforts to assess and enhance the performance and effectiveness of language models and prompts. Create synthetic and curated datasets and drive iterative improvements.
* program management: oversee large-scale, cross-functional evaluation programs; develop and maintain robust measurement frameworks to track llm performance and user impact. Partner with engineering to build automated evaluation pipelines integrated into product workflows.
* user experience enhancement: collaborate with ux teams to evaluate and optimize user interactions with ai systems, improving satisfaction and usability.
* responsible ai (rai): implement responsible ai principles to ensure ethical, unbiased practices in model development and deployment.
* research contributions: lead deep research initiatives in llm evaluation and user experience optimization; contribute to the scientific community and strengthen understanding of user mental models and alignment with llm-powered experiences.
* cross-functional collaboration: work with engineering, research, and product teams to integrate evaluation processes into the development lifecycle.
qualifications
required qualifications:
* bachelor’s degree in statistics, econometrics, computer science, electrical or computer engineering, or related field with 4+ years of related experience (e.g., statistics, predictive analytics, research) or master’s degree in these fields with 3+ years of related experience or doctorate with 1+ year of related experience or equivalent experience.
* extensive experience in data science, machine learning, experimentation, and ai, with a track record of delivering impactful results.
* expertise in llms, including finetuning, reinforcement learning, evaluation techniques, rag techniques, agentic workflows, and industry best practices.
* proven expertise in program management and leading cross-functional teams.
* proficient development experience in python.
* proficient understanding of responsible ai principles.
preferred qualifications
* ability to work in a fast-paced and dynamic environment.
* excellent analytical and problem-solving skills.
* exceptional communication and presentation abilities.
other requirements
* ability to meet microsoft, customer and/or government security screening requirements. This includes the microsoft cloud background check, which is required upon hire/transfer and every two years thereafter.
microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex, sexual orientation, or any other characteristic protected by applicable local laws. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
#j-18808-ljbffr