Learning Experiments

In a series of learning experiments, I would like to count the number of participants in each experiment that improved their performance in subsequent experiments (Rank 1 is highest). In addition, I would also like to count the number of participants in each experiment that subsequently reached the top rank.

Here is a short, sanitized version of the learning experiment csv file that I have loaded into a pandas dataframe (df_learning).

Please advise?

You can use a groupby.cummax, then boolean indexing:

m = df['Rank'].sub(df.groupby('Subject')['Rank'].cummax()).lt(0)improved_rank = df.loc[m, 'Subject'].unique()

output: ['Charlie', 'Echo', 'Juliet']

reached_top_rank = df.loc[m&df['Rank'].eq(1), 'Subject'].unique()

output: ['Juliet']