Job Requisition ID #
Position Overview
The work we do at Autodesk touches nearly every person on the planet. By creating software tools for making buildings, machines, and even the latest movies, we influence and empower some of the most creative people in the world.
As a Senior Machine Learning Engineer at Autodesk Research, you will work side-by-side with world-class researchers and engineers to build new ML-powered product features that help our customers imagine, design, and make a better world.
You are a software engineer who is passionate about solving problems and building things. You are excited to collaborate with AI researchers to implement generative AI features in Autodesk products.
You will report to a research manager in the Autodesk AI Lab team within Autodesk Research. We are a global team located in London, San Francisco, Toronto, and remote locations. For this role, we support in-person, hybrid, and remote work arrangements.
Responsibilities
Design, architect and implement comprehensive monitoring systems for foundation models in production, establishing best practices for tracking key metrics and monitoring performance drift across multiple models and environments
Build and own robust alerting systems to proactively detect model drift, performance anomalies, and data quality issues, defining thresholds and response strategies in collaboration with cross-functional teams
Design, build and maintain scalable data pipelines for model training, fine-tuning, and evaluation, ensuring reliability, efficiency, and adherence to engineering best practices
Implement data quality checks for response and prediction log datasets and ensure data integrity at scale
Lead the development of interactive dashboards and visualization tools for stakeholders to monitor model performance, usage patterns, and business metrics, translating technical metrics into actionable business insights
Own and develop comprehensive reporting systems to track model performance trends, ensuring SLA compliance, and provide data-driven recommendations for continuous development
Minimum Qualifications
BSc or MSc in Computer Science, or equivalent industry experience
3+ years of related industry experience
Experience with databases and SQL for data management and querying
Proficiency with JupyterNotebooks, data visualization libraries (e.g., Plotly, Matplotlib), and data analysis libraries (e.g., scikit-learn)
Hands-on experience with ML Ops tools and practices, including experiment tracking, model versioning, and production monitoring (e.g., MLflow, Weights & Biases, TensorBoard)
Experience with version control, reproducibility, and writing reusable, testable code
Experience with data modelling, architecture, and processing using varied data representations, including 2D and 3D geometry
Experience with cloud services and architectures (e.g., AWS, Azure)
Excellent written documentation skills to document code, architectures, and experiments
Preferred Qualifications
Experience scaling ML data pipelines
Proficiency with advanced model monitoring platforms and observability tools (e.g., Evidently AI, Arize AI, Fiddler, Datadog ML Monitoring, Grafana)
Proven experience implementing drift detection strategies (data drift, concept drift, prediction drift) and automated remediation workflows
Experience designing and conducting A/B testing and experimentation frameworks for ML models, including statistical analysis and causal inference
Knowledge of GenAI-specific evaluation metrics and methodologies
Knowledge of the design, manufacturing, AEC, or media & entertainment industries
Experience with Autodesk or similar products (CAD, CAE, CAM, etc.)
Learn More
About Autodesk
Welcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.
We take great pride in our culture here at Autodesk – it’s at the core of everything we do. Our culture guides the way we work and treat each other, informs how we connect with customers and partners, and defines how we show up in the world.
When you’re an Autodesker, you can do meaningful work that helps build a better world designed and made for all. Ready to shape the world and your future? Join us!
Salary transparency
Salary is one part of Autodesk’s competitive compensation package. Offers are based on the candidate’s experience and geographic location. In addition to base salaries, our compensation package may include annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.Diversity & Belonging
We take pride in cultivating a culture of belonging where everyone can thrive. Learn more here: https://www.autodesk.com/company/diversity-and-belonging
Are you an existing contractor or consultant with Autodesk?
Please search for open jobs and apply internally (not on this external site).
