Anna Hakhverdyan
Anna Hakhverdyan Աննա Հախվերդյան

PhD in Computer Science

Brown University

I am a first-year Computer Science PhD student at Brown University, advised by George Konidaris in the Intelligent Robot Lab (IRL).

Previously, I was an MSc (Thesis) student in Computing Science at the University of Alberta, advised by Martha White in the RLAI Lab. I earned my bachelor’s degree in my home country, Armenia, in National Polytechnic University of Armenia.

During my master’s, I focused on developing online reinforcement learning agents that dynamically tune hyperparameters during allocated agent-environment interactions. I have also contributed to designing environments that are partially observable, never-ending, and continually changing, to evaluate the agent’s adaptability.

I am interested in developing agents that operate in a partially observable setting in an online manner. In my opinion, one way to achieve this is by quantifying the amount of information an agent needs for efficient decision-making, as the agent relies on its experience in such environments. This interest also leads me to explore capacity-constrained agents—those with limits on the information they can obtain about the world they inhabit—which I believe is a key ingredient in achieving natural intelligence.

Contact: ahakhver [at] brown [dot] edu

Download CV
Interests
  • Partial Observability
  • Continual Learning
  • Capacity-constrained Learning
  • Agency/Causality of Agents
Education
  • PhD in Computer Science

    Brown University

  • MSc in Computing Science

    University of Alberta

  • BSc in Information Technologies

    National Polytechnic University of Armenia

Publications
(2022). NS3: Neuro-symbolic Semantic Code Search. In NeurIPS'22.

Experience

  1. Research Intern

    Huawei Canada
    • Online hyperparameter tuning for LLM agents.
  2. Research Assistant

    University of Alberta - RLAI Lab
    • Developed RL-automated PID controller for a process control environment.
    • Worked on developing environments suitable for lifelong learning.
  3. Machine Learning Engineer

    Magical Labs
    • Developed models and pipelines for autonomous vehicle control.
    • Worked on compressing large neural networks with RL agents for mobile integration.
  4. Machine Learning Engineer

    Perpetuum Motors
    • Conducted research on developing an end-to-end autonomous driving pipeline for simulated games.
  5. Software Engineer

    ForgeFiction
    • Developed and designed API requests and database architectures.
    • Optimized the application for maximum speed and scalability.

Education

  1. PhD in Computer Science

    Brown University
  2. MSc in Computing Science

    University of Alberta
    Thesis: Accounting for Hyperparameter Tuning in Online Reinforcement Learning
  3. BSc in Information Technologies

    National Polytechnic University of Armenia
Technical Skills and Hobbies
Python
Bash, Version Control
SQL, NoSQL
Jax, PyTorch, Numpy
Reading

Photography
Writing
Languages
100%
Armenian
95%
English
95%
Russian
65%
Japanese
45%
Korean