Advice for a project

I have to complete a university internship, and my professor asked me to contribute to the continuation of a paper he previously wrote and published.

During a meeting with him, he suggested that I prepare by studying two topics:

1. Behavioral Learning / Imitation Learning
2. Inverse Reinforcement Learning

Additionally, the professor teaches a Reinforcement Learning course (6 ECTS credits) that includes a project as part of the final exam. I was thinking that it would be a great idea to work on a project related to the two topics he recommended. This way, I could prepare both for the internship and for the exam at the same time.

Does anyone have any suggestions or advice on how to choose a good project?

The project could involve practical coding to solve a known problem, reproducing the results of a paper, or anything else if someone has interesting ideas.

After doing some research online, I found a few project ideas that seem interesting, but I’m not sure how useful or relevant they would actually be:

1. “FSC vs. Traditional Behavioral Cloning in POMDP Environments” (Practical and Comparative)
2. “Inverse Reinforcement Learning (IRL) vs. Inverse Inference (FSC)” (More Theoretical and Conceptual)
3. “Reproducing and Extending a Synthetic Agent from the Paper” (Results Reproduction)

P.S. The paper is about decoding the minimal internal state starting from a biological agent model. So the topic should be mainly theoretical, with a practical component used to validate results and assumptions.

Thanks a lot everyone, and have a great day!