LLM Data Scientist, Senior Associate

Overview

Senior Associate (LLM Data Scientist) joining State Street’s GenAI Center of Excellence to advance and evaluate large language model capabilities through experimentation and applied research.

What you'll do

• Design and implement experiments and fine-tuning workflows (e.g., LoRA, QLoRA) using Python.
• Support benchmarking and evaluation of LLMs, including performance analysis and anomaly detection.
• Assist with data curation, preprocessing, and preparation for model training and evaluation.
• Document experiment results, insights, and methodologies, and maintain internal knowledge repositories.
• Participate in model review sessions and apply state-of-the-art evaluation methodologies.

What you'll need

• Bachelor’s degree in Computer Science, Data Science, Statistics, Mathematics, or a related technical field.
• 0–7 years of overall experience in IT.
• 3+ years of experience in applied machine learning/data science (including internships or academic research).
• Proficiency in Python and hands-on experience with ML frameworks such as PyTorch or TensorFlow.
• Basic understanding of LLM architectures, fine-tuning techniques, and Python-based training pipelines.
• Familiarity with evaluation metrics for generative models and analyzing model results using Python.
• Familiarity with cloud AI/ML services (AWS, Azure, or GCP) and MLOps practices.