Anna Hakhverdyan
Anna Hakhverdyan Աննա Հախվերդյան

MSc in Computing Science

University of Alberta

I am a Research Assistant at the University of Alberta working with Martha White in the RLAI Lab.

My current research centers on online reinforcement learning (RL), specifically developing methods that dynamically tune hyperparameters during allocated agent-environment interactions. I have also contributed to designing environments that are partially observable, never-ending, and continually changing, in order to evaluate the agent’s adaptability, similar to how natural intelligences operate. I also study how rich, diverse, task-agnostic observations can enhance an agent’s abilities across simple and complex RL environments.

I have recently developed a keen interest in quantifying the amount of information an agent needs for efficient decision-making, especially in a partially observable setting. I am interested in exploring capacity-constrained agents - agents with constraints on the information they can get about the world they live in.

Contact: hakhverd [at] ualberta [dot] ca

Download CV
Interests
  • Lifelong RL
  • Capacity-constrained Learning
  • Hierarchical RL
  • Single-lifetime Agents
Education
  • MSc in Computing Science

    University of Alberta

  • BSc in Information Technologies

    National Polytechnic University of Armenia

Publications
(2022). NS3: Neuro-symbolic Semantic Code Search. In NeurIPS'22.

Experience

  1. Research Assistant

    University of Alberta - RLAI Lab

    Responsibilities include:

    • Finishing up my thesis work for journal submission.
    • Developing RL-automated PID controller for a process control environment.
    • Working on developing environments suitable for lifelong learning.
    • Analyzing the impact of partial observability and limited information on experiments inspired by animal learning.
  2. Machine Learning Engineer

    Magical Labs

    Responsibilities include:

    • Developed models and pipelines for autonomous vehicle control.
    • Worked on compressing large neural networks with RL agents for mobile integration.
  3. Machine Learning Engineer

    Perpetuum Motors

    Responsibilities include:

    • Conducted research on developing an end-to-end autonomous driving pipeline for simulated games.
  4. Software Engineer

    ForgeFiction

    Responsibilities include:

    • Developed and designed API requests and database architectures.
    • Optimized the application for maximum speed and scalability.

Education

  1. MSc in Computing Science

    University of Alberta

    GPA: 3.8/4.0

    My Master’s thesis explores online hyperparameter tuning in reinforcement learning, where an agent adapts its hyperparameters during interactions rather than relying on a pre-tuning phase.

  2. BSc in Information Technologies

    National Polytechnic University of Armenia
    GPA: 3.92/4.0
Technical Skills and Hobbies
Python
Bash, Version Control
SQL, NoSQL
Jax, PyTorch, Numpy
Reading

Photography
Cooking
Languages
100%
Armenian
95%
English
95%
Russian
75%
Japanese
60%
Korean