Brainstorm session with Susan Murphy (CANCELLED)
- https://wsc.project.cwi.nl/ml-reading-group/events/brainstorm-session-with-susan-murphy
- Brainstorm session with Susan Murphy (CANCELLED)
- 2021-11-19T15:00:00+01:00
- 2021-11-19T16:30:00+01:00
- Susan Murphy will visit our group after receiving the Van Wijngaarden award on Thursday and speaking in the CWI Scientifc Meeting on Friday. Friday afternoon we are hosting a brainstorm session about analysis of data that is collected by reinforcement learning algorithms.
- When Nov 19, 2021 from 03:00 PM to 04:30 PM (Europe/Amsterdam / UTC100)
- Where L102 Adriaan
- Add event to calendar iCal
This would be about analysis methods for data on n users that is collected via a RL type algorithm over T time points.
At each time t, the algorithm pools the data prior to time t on the n users in order to select the action at time t. You can imagine that each user has a tree of potential outcomes (each level of the tree corresponds to a time point; each tree is of depth T; there is likely correlation in outcomes across time within a user). The potential outcome trees are iid across users, but the observed data is not. The challenge is how to take advantage of the fact that the potential trees are iid across users when conducting after study analyses with this type of data (like m-estimation or off-policy analyses or causal inference analyses).
We have ideas about how to do this and would like feedback.
This event has been cancelled.